Jul 10 04:26:54 devstack cinder-volume[76114]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 04:26:54 devstack cinder-volume[76114]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 04:26:54 devstack cinder-volume[76114]: we strongly recommend against using it for new projects. Jul 10 04:26:54 devstack cinder-volume[76114]: If you are already using Eventlet, we recommend migrating to a different Jul 10 04:26:54 devstack cinder-volume[76114]: framework. For more detail see Jul 10 04:26:54 devstack cinder-volume[76114]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 04:26:54 devstack cinder-volume[76114]: import eventlet # noqa Jul 10 04:26:57 devstack cinder-volume[76114]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76114) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 04:26:57 devstack cinder-volume[76114]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76114) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 04:26:57 devstack cinder-volume[76114]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76114) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 04:26:57 devstack cinder-volume[76114]: INFO dbcounter [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Registered counter for database cinder Jul 10 04:26:57 devstack cinder-volume[76114]: DEBUG oslo_db.sqlalchemy.engines [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76114) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:26:58 devstack cinder-volume[76114]: DEBUG dbcounter [-] [76114] Writer thread running {{(pid=76114) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 04:26:58 devstack cinder-volume[76114]: INFO cinder.rpc [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 04:26:58 devstack cinder-volume[76114]: INFO cinder.rpc [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 04:26:58 devstack cinder-volume[76114]: DEBUG oslo_db.sqlalchemy.engines [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76114) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:26:58 devstack cinder-volume[76114]: INFO cinder.volume.manager [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Determined volume DB was empty at startup. Jul 10 04:26:58 devstack cinder-volume[76114]: DEBUG cinder.volume.manager [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76114) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 04:26:58 devstack cinder-volume[76114]: INFO cinder.volume.manager [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 04:26:58 devstack cinder-volume[76114]: WARNING stevedore.named [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 04:26:58 devstack cinder-volume[76114]: WARNING castellan.key_manager [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 04:26:58 devstack cinder-volume[76114]: WARNING cinder.keymgr.conf_key_mgr [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 04:26:58 devstack cinder-volume[76114]: DEBUG cinder.volume.drivers.lvm [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76114) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 10 04:26:58 devstack cinder-volume[76114]: DEBUG oslo_concurrency.processutils [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76114) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:58 devstack cinder-volume[76114]: DEBUG oslo_concurrency.processutils [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] CMD "cinder-rtstool verify" returned: 0 in 0.442s {{(pid=76114) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_db.sqlalchemy.engines [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76114) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:26:59 devstack cinder-volume[76114]: INFO cinder.rpc [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 10 04:26:59 devstack cinder-volume[76114]: INFO cinder.rpc [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 10 04:26:59 devstack cinder-volume[76114]: WARNING stevedore.named [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 04:26:59 devstack cinder-volume[76114]: WARNING castellan.key_manager [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 04:26:59 devstack cinder-volume[76114]: INFO cinder.volume.manager [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_db.sqlalchemy.engines [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76114) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:26:59 devstack cinder-volume[76114]: INFO oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Starting 1 workers Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Started child 76289 {{(pid=76114) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Full set of CONF: {{(pid=76114) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] ******************************************************************************** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Configuration options gathered from: {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] ================================================================================ {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] allow_availability_zone_fallback = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] allow_compression_on_image_upload = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] allowed_direct_url_schemes = [] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] api_rate_limit = True {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] auth_strategy = keystone {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76289]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] az_cache_duration = 3600 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_availability_zone = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_host = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_name = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_stats_polling_interval = 60 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backup_api_class = cinder.backup.api.API {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backup_name_template = backup-%s {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backup_use_same_host = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backup_use_temp_snapshot = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] chap_password = **** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] chap_username = {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cinder_internal_tenant_project_id = a61d86174d4b436fa8bccbd5fb51dcdb {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cinder_internal_tenant_user_id = e6041e31ff894bb8a5a1cbd34ef84b7d {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cloned_volume_same_az = True {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cluster = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] compression_format = gzip {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] compute_api_class = cinder.compute.nova.API {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] config_dir = [] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] config_source = [] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] control_exchange = openstack {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] debug = True {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] default_availability_zone = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] default_group_type = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] default_volume_type = lvmdriver-1 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] disk_geometry = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] driver_client_cert = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] driver_client_cert_key = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] driver_data_namespace = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] driver_ssl_cert_path = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] driver_ssl_cert_verify = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] driver_use_ssl = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] enable_force_upload = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] enable_new_services = True {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] enable_unsupported_driver = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] enforce_multipath_for_image_xfer = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] filter_function = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] glance_api_insecure = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] glance_api_servers = ['http://192.168.122.165/image'] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] glance_api_ssl_compression = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] glance_ca_certificates_file = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] glance_catalog_info = image:glance:publicURL {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] glance_certfile = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76289]: INFO cinder.volume.manager [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] glance_keyfile = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] glance_num_retries = 3 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] glance_request_timeout = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] goodness_function = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] graceful_shutdown_timeout = 5 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] group_api_class = cinder.group.api.API {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] host = devstack {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] image_compress_on_upload = True {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] image_conversion_address_space_limit = 1 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] image_conversion_cpu_limit = 60 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] image_conversion_disable = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] image_upload_use_cinder_backend = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] image_upload_use_internal_tenant = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] image_volume_cache_enabled = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] image_volume_cache_max_count = 0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] image_volume_cache_max_size_gb = 0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] init_host_max_objects_retrieval = 0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] instance_format = [instance: %(uuid)s] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] iscsi_target_flags = {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] iscsi_write_cache = on {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] iser_helper = tgtadm {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] iser_ip_address = 192.168.122.165 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] iser_port = 3260 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] log_color = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] log_config_append = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] log_dir = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] log_file = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] log_options = True {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] log_rotate_interval = 1 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] log_rotate_interval_type = days {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] log_rotation_type = none {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] max_age = 0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] max_logfile_count = 30 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] max_logfile_size_mb = 200 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] max_over_subscription_ratio = 20.0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] message_reap_interval = 86400 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] message_ttl = 2592000 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] migration_create_volume_timeout_secs = 300 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack sudo[76293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] monkey_patch = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] monkey_patch_modules = [] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] my_ip = 192.168.122.165 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] no_snapshot_gb_quota = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] num_iser_scan_tries = 3 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] num_shell_tries = 3 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] num_volume_device_scan_tries = 3 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack sudo[76293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] nvmeof_conn_info_version = 1 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] nvmet_ns_id = 10 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] nvmet_port_id = 1 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] osapi_max_limit = 1000 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] osapi_volume_ext_list = [] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] osapi_volume_listen_port = 8776 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] osapi_volume_use_ssl = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] osapi_volume_workers = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] per_volume_size_limit = -1 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] periodic_fuzzy_delay = 60 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] periodic_interval = 60 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] public_endpoint = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] publish_errors = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] quota_backup_gigabytes = 1000 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] quota_backups = 10 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] quota_gigabytes = 1000 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] quota_groups = 10 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] quota_snapshots = 10 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] quota_volumes = 10 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] rate_limit_burst = 0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] rate_limit_except_level = CRITICAL {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] rate_limit_interval = 0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] reinit_driver_count = 3 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] replication_device = **** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] report_discard_supported = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] report_interval = 120 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] reservation_clean_interval = 86400 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] reservation_expire = 86400 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] reserved_image_namespaces = [] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] reserved_percentage = 0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] rpc_response_timeout = 120 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] run_external_periodic_tasks = True {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] scst_target_driver = iscsi {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] scst_target_iqn_name = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] service_down_time = 720 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] shell_completion = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] snapshot_name_template = snapshot-%s {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] snapshot_same_host = True {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] split_loggers = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] state_path = /opt/stack/data/cinder {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] storage_availability_zone = nova {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] storage_protocol = iSCSI {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] syslog_log_facility = LOG_USER {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] target_helper = lioadm {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] target_ip_address = 192.168.122.165 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] target_port = 3260 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] target_protocol = iscsi {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] target_secondary_ip_addresses = [] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] trace_flags = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] transport_url = **** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] until_refresh = 0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] use_chap_auth = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] use_default_quota_class = True {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] use_journal = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] use_json = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] use_multipath_for_image_xfer = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] use_stderr = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] use_syslog = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:59 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] verify_glance_signatures = enabled {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] volume_api_class = cinder.volume.api.API {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] volume_backend_name = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] volume_clear = zero {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] volume_clear_ionice = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] volume_clear_size = 0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] volume_copy_bps_limit = 0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] volume_dd_blocksize = 1M {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] volume_name_template = volume-%s {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] volume_service_inithost_offload = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] volume_usage_audit_period = month {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] zoning_mode = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_concurrency.disable_process_locking = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.auth_section = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.auth_type = password {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.auth_version = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.cache = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.certfile = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.include_service_catalog = True {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.insecure = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.interface = public {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.keyfile = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.memcache_password = {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.memcache_username = {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.region_name = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.service_type = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.165/identity {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.backend = dogpile.cache.null {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.backend_argument = **** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.backend_expiration_time = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.config_prefix = cache.oslo {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.debug_cache_backend = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.enable_retry_client = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.enable_socket_keepalive = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.enabled = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.expiration_time = 600 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.hashclient_retry_attempts = 2 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.memcache_dead_retry = 300 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.memcache_pool_maxsize = 10 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.memcache_sasl_enabled = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.password = **** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.proxies = [] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.redis_db = 0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.redis_server = localhost:6379 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.retry_attempts = 2 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.retry_delay = 0.0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.socket_keepalive_count = 1 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.socket_keepalive_idle = 1 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.socket_keepalive_interval = 1 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.socket_timeout = 1.0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.tls_allowed_ciphers = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.tls_cafile = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.tls_certfile = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.tls_enabled = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.tls_keyfile = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cache.username = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] coordination.backend_url = **** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.asyncio_connection = **** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.asyncio_slave_connection = **** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.backend = sqlalchemy {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.connection = **** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.connection_debug = 0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.connection_parameters = {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.connection_recycle_time = 3600 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.connection_trace = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.db_inc_retry_interval = True {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.db_max_retries = 20 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.db_max_retry_interval = 10 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.db_retry_interval = 1 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.max_overflow = 50 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.max_pool_size = 5 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.max_retries = 10 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.mysql_wsrep_sync_wait = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.pool_timeout = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.retry_interval = 10 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.slave_connection = **** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.sqlite_synchronous = True {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.synchronous_reader = True {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] database.use_db_reconnect = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] profiler.connection_string = messaging:// {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] profiler.enabled = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] profiler.es_doc_type = notification {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] profiler.es_scroll_size = 10000 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] profiler.es_scroll_time = 2m {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] profiler.filter_error_trace = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] profiler.hmac_keys = **** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] profiler.sentinel_service_name = mymaster {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] profiler.socket_timeout = 0.1 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] profiler.trace_requests = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] profiler.trace_sqlalchemy = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] profiler_jaeger.process_tags = {} {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] profiler_jaeger.service_name_prefix = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] profiler_otlp.service_name_prefix = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_policy.enforce_new_defaults = True {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_policy.enforce_scope = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_policy.policy_default_rule = default {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_policy.policy_file = policy.yaml {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] privsep_osbrick.group = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] privsep_osbrick.helper_command = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] privsep_osbrick.user = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cinder_sys_admin.group = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cinder_sys_admin.helper_command = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] cinder_sys_admin.user = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] service_user.auth_section = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] service_user.auth_type = password {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] service_user.cafile = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] service_user.certfile = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] service_user.collect_timing = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] service_user.insecure = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] service_user.keyfile = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] service_user.send_service_user_token = True {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] service_user.split_loggers = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] service_user.timeout = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] glance.auth_section = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] glance.auth_type = password {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] glance.certfile = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] glance.collect_timing = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] glance.insecure = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] glance.keyfile = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] glance.region_name = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] glance.split_loggers = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] glance.timeout = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.backend_availability_zone = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.chap_password = **** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.chap_username = {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.disk_geometry = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.driver_client_cert = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.driver_client_cert_key = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.driver_data_namespace = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.driver_use_ssl = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.extra_capabilities = {} {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.filter_function = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.goodness_function = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.iscsi_target_flags = {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.iscsi_write_cache = on {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.iser_helper = tgtadm {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.iser_ip_address = 192.168.122.165 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.iser_port = 3260 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.lvm_share_target = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.lvm_type = auto {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.num_shell_tries = 3 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.replication_device = **** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.report_discard_supported = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.reserved_percentage = 0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.target_helper = tgtadm {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.target_ip_address = 192.168.122.165 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.target_port = 3260 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.target_protocol = iscsi {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.trace_flags = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.unique_fqdn_network = True {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.use_chap_auth = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.volume_backend_name = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.volume_clear = zero {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.volume_clear_ionice = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.volume_clear_size = 0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_reports.file_event_handler = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_reports.log_dir = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.backend_host = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.chap_password = **** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.chap_username = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.disk_geometry = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.driver_client_cert = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.extra_capabilities = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.filter_function = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.goodness_function = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.iser_helper = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.iser_ip_address = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.iser_port = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.lvm_share_target = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.lvm_type = auto {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.num_shell_tries = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.replication_device = **** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.report_discard_supported = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.reserved_percentage = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.scst_target_driver = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.storage_protocol = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.target_helper = lioadm {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.target_ip_address = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.target_port = 3260 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.trace_flags = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.use_chap_auth = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.volume_clear = zero {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.volume_clear_size = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] lvmdriver-1.volumes_dir = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.ssl = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_notifications.driver = [] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_notifications.retry = -1 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] key_manager.fixed_key = **** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican.barbican_api_version = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican.barbican_endpoint = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican.barbican_endpoint_type = public {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican.barbican_region_name = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican.cafile = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican.certfile = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican.collect_timing = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican.insecure = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican.keyfile = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican.number_of_retries = 60 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican.retry_delay = 1 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican.send_service_user_token = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican.split_loggers = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican.timeout = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican.verify_ssl = True {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican.verify_ssl_path = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican_service_user.auth_section = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican_service_user.auth_type = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican_service_user.cafile = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican_service_user.certfile = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican_service_user.collect_timing = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican_service_user.insecure = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican_service_user.keyfile = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican_service_user.split_loggers = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] barbican_service_user.timeout = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] vault.approle_role_id = **** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] vault.approle_secret_id = **** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] vault.kv_mountpoint = secret {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] vault.kv_path = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] vault.kv_version = 2 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] vault.namespace = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] vault.root_token_id = **** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] vault.ssl_ca_crt_file = None {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] vault.timeout = 60.0 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] vault.use_ssl = False {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:59 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] ******************************************************************************** {{(pid=76114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 04:27:00 devstack sudo[76293]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:00 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.808s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:00 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:00 devstack sudo[76319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:27:00 devstack sudo[76319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:00 devstack sudo[76319]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:00 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.668s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:00 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:27:00 devstack cinder-volume[76289]: INFO cinder.brick.local_dev.lvm [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 10 04:27:00 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:00 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:00 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:00 devstack sudo[76562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 04:27:00 devstack sudo[76562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:01 devstack sudo[76562]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:01 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:01 devstack cinder-volume[76289]: DEBUG cinder.brick.local_dev.lvm [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76289) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 10 04:27:01 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:01 devstack sudo[76779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:27:01 devstack sudo[76779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:03 devstack sudo[76779]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:03 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.546s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:03 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:03 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:03 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:03 devstack sudo[77043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:27:03 devstack sudo[77043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:03 devstack sudo[77043]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:03 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.758s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:03 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:03 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:03 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:03 devstack sudo[77071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 10 04:27:03 devstack sudo[77071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:04 devstack sudo[77071]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:04 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.722s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:04 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:04 devstack sudo[77075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 04:27:04 devstack sudo[77075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:05 devstack sudo[77075]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:05 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.808s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:05 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:05 devstack sudo[77087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 04:27:05 devstack sudo[77087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:06 devstack sudo[77087]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:06 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.840s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:06 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:06 devstack sudo[77092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:27:06 devstack sudo[77092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:07 devstack sudo[77092]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:07 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.898s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:07 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:07 devstack sudo[77098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:27:07 devstack sudo[77098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:07 devstack sudo[77098]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:08 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.752s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:08 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:08 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:08 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:08 devstack sudo[77106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:27:08 devstack sudo[77106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:08 devstack sudo[77106]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:08 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.862s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:08 devstack cinder-volume[76289]: INFO cinder.volume.drivers.lvm [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 10 04:27:08 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:08 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:08 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:08 devstack sudo[77160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:27:08 devstack sudo[77160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:09 devstack cinder-volume[76114]: DEBUG dbcounter [-] [76114] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76114) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:27:09 devstack sudo[77160]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:09 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.780s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:09 devstack cinder-volume[76289]: DEBUG cinder.volume.drivers.lvm [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Updating volume stats {{(pid=76289) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 04:27:09 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:09 devstack sudo[77350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 04:27:09 devstack sudo[77350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:10 devstack sudo[77350]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:10 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:10 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:10 devstack sudo[77380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:27:10 devstack sudo[77380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:10 devstack sudo[77380]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:10 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:10 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:11 devstack sudo[77383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:27:11 devstack sudo[77383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:11 devstack sudo[77383]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:11 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.659s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:11 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:11 devstack sudo[77386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:27:11 devstack sudo[77386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:12 devstack sudo[77386]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:12 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:12 devstack cinder-volume[76289]: INFO cinder.volume.driver [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 04:27:12 devstack cinder-volume[76289]: DEBUG cinder.volume.driver [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76289) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 04:27:12 devstack cinder-volume[76289]: DEBUG oslo_db.sqlalchemy.engines [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76289) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:27:12 devstack cinder-volume[76289]: DEBUG dbcounter [-] [76289] Writer thread running {{(pid=76289) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 04:27:12 devstack cinder-volume[76289]: DEBUG cinder.db.api [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Building query based on filter {{(pid=76289) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 04:27:12 devstack cinder-volume[76289]: DEBUG cinder.image.image_utils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76289) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1331}} Jul 10 04:27:12 devstack cinder-volume[76289]: INFO cinder.keymgr.migration [None req-35ed0434-08b2-451f-a0d3-adb0579cbdd2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 04:27:12 devstack cinder-volume[76289]: DEBUG cinder.volume.drivers.lvm [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Updating volume stats {{(pid=76289) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 04:27:12 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:12 devstack sudo[77394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 04:27:12 devstack sudo[77394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:13 devstack sudo[77394]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:13 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.712s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:13 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:13 devstack sudo[77398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:27:13 devstack sudo[77398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:13 devstack sudo[77398]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:13 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.688s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:13 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:13 devstack sudo[77401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:27:13 devstack sudo[77401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:14 devstack sudo[77401]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:14 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.715s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:14 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:14 devstack sudo[77405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:27:14 devstack sudo[77405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:15 devstack sudo[77405]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:15 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.686s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:15 devstack cinder-volume[76289]: DEBUG cinder.manager [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Notifying Schedulers of capabilities ... {{(pid=76289) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:27:15 devstack cinder-volume[76289]: INFO cinder.volume.manager [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Driver initialization completed successfully. Jul 10 04:27:15 devstack cinder-volume[76289]: INFO cinder.manager [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Initiating service 2 cleanup Jul 10 04:27:15 devstack cinder-volume[76289]: INFO cinder.manager [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Service 2 cleanup completed. Jul 10 04:27:15 devstack cinder-volume[76289]: DEBUG cinder.service [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Creating RPC server for service cinder-volume {{(pid=76289) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 04:27:15 devstack cinder-volume[76289]: DEBUG cinder.service [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76289) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 04:27:15 devstack cinder-volume[76289]: INFO cinder.volume.manager [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 10 04:27:15 devstack cinder-volume[76289]: DEBUG cinder.volume.drivers.lvm [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Updating volume stats {{(pid=76289) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 04:27:15 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:15 devstack sudo[77409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 04:27:15 devstack sudo[77409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:16 devstack sudo[77409]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:16 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.692s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:16 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:16 devstack sudo[77415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:27:16 devstack sudo[77415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:16 devstack sudo[77415]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:16 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:16 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:16 devstack sudo[77472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:27:16 devstack sudo[77472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:17 devstack sudo[77472]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:17 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.648s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:17 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:27:17 devstack sudo[77475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:27:17 devstack sudo[77475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:27:18 devstack sudo[77475]: pam_unix(sudo:session): session closed for user root Jul 10 04:27:18 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:27:18 devstack cinder-volume[76289]: INFO cinder.volume.manager [None req-2d3188b4-7b8d-4b54-8c19-cdcedf00d892 None None] Driver post RPC initialization completed successfully. Jul 10 04:27:22 devstack cinder-volume[76289]: DEBUG dbcounter [-] [76289] Writing DB stats cinder:SELECT=2 {{(pid=76289) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:27:28 devstack cinder-volume[76289]: DEBUG dbcounter [-] [76289] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76289) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:28:01 devstack cinder-volume[76289]: DEBUG oslo_service.periodic_task [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:28:01 devstack cinder-volume[76289]: DEBUG cinder.volume.drivers.lvm [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Updating volume stats {{(pid=76289) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 04:28:01 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:28:01 devstack sudo[79019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 04:28:01 devstack sudo[79019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:28:01 devstack sudo[79019]: pam_unix(sudo:session): session closed for user root Jul 10 04:28:01 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:28:01 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:28:01 devstack sudo[79022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:28:01 devstack sudo[79022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:28:02 devstack sudo[79022]: pam_unix(sudo:session): session closed for user root Jul 10 04:28:02 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:28:02 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:28:02 devstack sudo[79089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:28:02 devstack sudo[79089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:28:02 devstack sudo[79089]: pam_unix(sudo:session): session closed for user root Jul 10 04:28:02 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.626s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:28:02 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:28:02 devstack sudo[79092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:28:02 devstack sudo[79092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:28:03 devstack sudo[79092]: pam_unix(sudo:session): session closed for user root Jul 10 04:28:03 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:28:03 devstack cinder-volume[76289]: DEBUG cinder.manager [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Notifying Schedulers of capabilities ... {{(pid=76289) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:28:03 devstack cinder-volume[76289]: DEBUG oslo_service.periodic_task [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Running periodic task VolumeManager._thread_info {{(pid=76289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:28:03 devstack cinder-volume[76289]: DEBUG cinder.volume.manager [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] thread count: 6 {{(pid=76289) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:28:03 devstack cinder-volume[76289]: DEBUG cinder.volume.manager [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] thread info: [<_MainThread(MainThread, started 136715046281344)>, , , , , ] {{(pid=76289) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:29:01 devstack cinder-volume[76289]: DEBUG oslo_service.periodic_task [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:29:01 devstack cinder-volume[76289]: DEBUG cinder.volume.drivers.lvm [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Updating volume stats {{(pid=76289) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 04:29:01 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:29:01 devstack sudo[82388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 04:29:01 devstack sudo[82388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:29:01 devstack sudo[82388]: pam_unix(sudo:session): session closed for user root Jul 10 04:29:01 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:29:01 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:29:01 devstack sudo[82391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:29:01 devstack sudo[82391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:29:02 devstack sudo[82391]: pam_unix(sudo:session): session closed for user root Jul 10 04:29:02 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.606s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:29:02 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:29:02 devstack sudo[82394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:29:02 devstack sudo[82394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:29:02 devstack sudo[82394]: pam_unix(sudo:session): session closed for user root Jul 10 04:29:02 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.622s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:29:02 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:29:02 devstack sudo[82397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:29:02 devstack sudo[82397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:29:03 devstack sudo[82397]: pam_unix(sudo:session): session closed for user root Jul 10 04:29:03 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:29:03 devstack cinder-volume[76289]: DEBUG cinder.manager [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Notifying Schedulers of capabilities ... {{(pid=76289) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:29:28 devstack cinder-volume[76289]: DEBUG dbcounter [-] [76289] Writing DB stats cinder:SELECT=1 {{(pid=76289) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:29:28 devstack cinder-volume[76289]: DEBUG dbcounter [-] [76289] Writing DB stats cinder:UPDATE=1 {{(pid=76289) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:30:01 devstack cinder-volume[76289]: DEBUG oslo_service.periodic_task [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:30:01 devstack cinder-volume[76289]: DEBUG cinder.volume.drivers.lvm [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Updating volume stats {{(pid=76289) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 04:30:01 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:30:01 devstack sudo[84238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 04:30:01 devstack sudo[84238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:30:01 devstack sudo[84238]: pam_unix(sudo:session): session closed for user root Jul 10 04:30:01 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:30:01 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:30:01 devstack sudo[84247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:30:01 devstack sudo[84247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:30:02 devstack sudo[84247]: pam_unix(sudo:session): session closed for user root Jul 10 04:30:02 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.721s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:30:02 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:30:02 devstack sudo[84250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:30:02 devstack sudo[84250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:30:03 devstack sudo[84250]: pam_unix(sudo:session): session closed for user root Jul 10 04:30:03 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.655s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:30:03 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:30:03 devstack sudo[84253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:30:03 devstack sudo[84253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:30:03 devstack sudo[84253]: pam_unix(sudo:session): session closed for user root Jul 10 04:30:03 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:30:03 devstack cinder-volume[76289]: DEBUG cinder.manager [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Notifying Schedulers of capabilities ... {{(pid=76289) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:30:03 devstack cinder-volume[76289]: DEBUG oslo_service.periodic_task [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] Running periodic task VolumeManager._thread_info {{(pid=76289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:30:03 devstack cinder-volume[76289]: DEBUG cinder.volume.manager [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] thread count: 6 {{(pid=76289) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:30:03 devstack cinder-volume[76289]: DEBUG cinder.volume.manager [None req-3accd76f-77e4-49d9-bb51-239a68f6855c None None] thread info: [<_MainThread(MainThread, started 136715046281344)>, , , , , ] {{(pid=76289) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:31:28 devstack cinder-volume[76289]: DEBUG dbcounter [-] [76289] Writing DB stats cinder:SELECT=1 {{(pid=76289) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:31:28 devstack cinder-volume[76289]: DEBUG dbcounter [-] [76289] Writing DB stats cinder:UPDATE=1 {{(pid=76289) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:31:33 devstack cinder-volume[76114]: INFO oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Caught SIGTERM, stopping children Jul 10 04:31:33 devstack cinder-volume[76114]: DEBUG oslo_concurrency.lockutils [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Acquiring lock "singleton_lock" {{(pid=76114) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 04:31:33 devstack cinder-volume[76114]: DEBUG oslo_concurrency.lockutils [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Acquired lock "singleton_lock" {{(pid=76114) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 04:31:33 devstack cinder-volume[76114]: DEBUG oslo_concurrency.lockutils [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Releasing lock "singleton_lock" {{(pid=76114) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 04:31:33 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Stop services. {{(pid=76114) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 04:31:33 devstack cinder-volume[76114]: DEBUG oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Killing children. {{(pid=76114) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 04:31:33 devstack cinder-volume[76114]: INFO oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Waiting on 1 children to exit Jul 10 04:31:35 devstack cinder-volume[76289]: DEBUG oslo_concurrency.lockutils [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Acquiring lock "singleton_lock" {{(pid=76289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 04:31:35 devstack cinder-volume[76289]: DEBUG oslo_concurrency.lockutils [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Acquired lock "singleton_lock" {{(pid=76289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 04:31:35 devstack cinder-volume[76289]: DEBUG oslo_concurrency.lockutils [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Releasing lock "singleton_lock" {{(pid=76289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 04:31:35 devstack cinder-volume[76289]: WARNING amqp [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 04:31:35 devstack cinder-volume[76289]: WARNING amqp [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 04:31:35 devstack cinder-volume[76114]: INFO oslo_service.backend._eventlet.service [None req-a0567408-6bc0-4253-b528-6cbedbdd07c2 None None] Child 76289 exited with status 0 Jul 10 04:31:35 devstack cinder-volume[86368]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 04:31:35 devstack cinder-volume[86368]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 04:31:35 devstack cinder-volume[86368]: we strongly recommend against using it for new projects. Jul 10 04:31:35 devstack cinder-volume[86368]: If you are already using Eventlet, we recommend migrating to a different Jul 10 04:31:35 devstack cinder-volume[86368]: framework. For more detail see Jul 10 04:31:35 devstack cinder-volume[86368]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 04:31:35 devstack cinder-volume[86368]: import eventlet # noqa Jul 10 04:31:37 devstack cinder-volume[86368]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86368) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 04:31:37 devstack cinder-volume[86368]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86368) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 04:31:37 devstack cinder-volume[86368]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86368) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 04:31:38 devstack cinder-volume[86368]: INFO dbcounter [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Registered counter for database cinder Jul 10 04:31:38 devstack cinder-volume[86368]: DEBUG oslo_db.sqlalchemy.engines [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86368) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:31:38 devstack cinder-volume[86368]: DEBUG dbcounter [-] [86368] Writer thread running {{(pid=86368) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 04:31:38 devstack cinder-volume[86368]: INFO cinder.rpc [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 04:31:38 devstack cinder-volume[86368]: INFO cinder.rpc [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 04:31:38 devstack cinder-volume[86368]: DEBUG oslo_db.sqlalchemy.engines [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86368) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:31:38 devstack cinder-volume[86368]: INFO cinder.volume.manager [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Determined volume DB was empty at startup. Jul 10 04:31:38 devstack cinder-volume[86368]: DEBUG cinder.volume.manager [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86368) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 04:31:38 devstack cinder-volume[86368]: INFO cinder.volume.manager [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 04:31:38 devstack cinder-volume[86368]: WARNING stevedore.named [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 04:31:38 devstack cinder-volume[86368]: WARNING castellan.key_manager [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 04:31:38 devstack cinder-volume[86368]: WARNING cinder.keymgr.conf_key_mgr [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 04:31:39 devstack cinder-volume[86368]: INFO cinder.volume.manager [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_db.sqlalchemy.engines [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86368) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:31:39 devstack cinder-volume[86368]: INFO oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Starting 1 workers Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Started child 86585 {{(pid=86368) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Full set of CONF: {{(pid=86368) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] ******************************************************************************** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Configuration options gathered from: {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] ================================================================================ {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] allow_availability_zone_fallback = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86585]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] allow_compression_on_image_upload = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] allowed_direct_url_schemes = [] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] api_rate_limit = True {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] auth_strategy = keystone {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_availability_zone = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_host = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_name = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_stats_polling_interval = 60 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backup_api_class = cinder.backup.api.API {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backup_name_template = backup-%s {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backup_use_same_host = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backup_use_temp_snapshot = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] chap_password = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] chap_username = {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cinder_internal_tenant_project_id = a61d86174d4b436fa8bccbd5fb51dcdb {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cinder_internal_tenant_user_id = e6041e31ff894bb8a5a1cbd34ef84b7d {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cluster = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] compression_format = gzip {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] compute_api_class = cinder.compute.nova.API {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] config_dir = [] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] config_source = [] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] control_exchange = openstack {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] debug = True {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] default_availability_zone = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] default_group_type = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] default_volume_type = QuobyteHD {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] disk_geometry = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] driver_client_cert = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] driver_client_cert_key = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] driver_data_namespace = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] driver_ssl_cert_path = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] driver_ssl_cert_verify = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] driver_use_ssl = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] enable_new_services = True {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] enable_unsupported_driver = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] enabled_backends = ['QuobyteHD'] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] enforce_multipath_for_image_xfer = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] filter_function = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] glance_api_insecure = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] glance_api_servers = ['http://192.168.122.165/image'] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] glance_api_ssl_compression = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] glance_ca_certificates_file = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] glance_catalog_info = image:glance:publicURL {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] glance_certfile = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] glance_keyfile = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] glance_num_retries = 3 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] glance_request_timeout = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] goodness_function = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] graceful_shutdown_timeout = 5 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] group_api_class = cinder.group.api.API {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] host = devstack {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] image_compress_on_upload = True {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] image_conversion_address_space_limit = 1 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] image_conversion_cpu_limit = 60 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] image_conversion_disable = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] image_upload_use_cinder_backend = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] image_upload_use_internal_tenant = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] image_volume_cache_enabled = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] image_volume_cache_max_count = 0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] image_volume_cache_max_size_gb = 0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] init_host_max_objects_retrieval = 0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] instance_format = [instance: %(uuid)s] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] iscsi_target_flags = {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] iscsi_write_cache = on {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] iser_helper = tgtadm {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] iser_ip_address = 192.168.122.165 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] iser_port = 3260 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] log_color = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] log_config_append = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] log_dir = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] log_file = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] log_options = True {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 04:31:39 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86585) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] log_rotate_interval = 1 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] log_rotate_interval_type = days {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] log_rotation_type = none {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] max_age = 0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] max_logfile_count = 30 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] max_logfile_size_mb = 200 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] max_over_subscription_ratio = 20.0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] message_reap_interval = 86400 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] message_ttl = 2592000 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] migration_create_volume_timeout_secs = 300 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] monkey_patch = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] monkey_patch_modules = [] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] my_ip = 192.168.122.165 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] no_snapshot_gb_quota = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] num_iser_scan_tries = 3 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] num_shell_tries = 3 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] num_volume_device_scan_tries = 3 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] nvmeof_conn_info_version = 1 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] nvmet_ns_id = 10 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] nvmet_port_id = 1 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] osapi_max_limit = 1000 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] osapi_volume_ext_list = [] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] osapi_volume_listen = 0.0.0.0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] osapi_volume_listen_port = 8776 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] osapi_volume_use_ssl = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] osapi_volume_workers = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] per_volume_size_limit = -1 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] periodic_fuzzy_delay = 60 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] periodic_interval = 60 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] project_id_regex = [0-9a-f\-]+ {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] public_endpoint = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] publish_errors = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] quota_backup_gigabytes = 1000 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] quota_backups = 10 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] quota_gigabytes = 1000 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] quota_groups = 10 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] quota_snapshots = 10 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] quota_volumes = 10 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] rate_limit_burst = 0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] rate_limit_except_level = CRITICAL {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] rate_limit_interval = 0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] reinit_driver_count = 3 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] replication_device = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] report_discard_supported = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] report_interval = 120 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] reservation_clean_interval = 86400 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] reservation_expire = 86400 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] reserved_image_namespaces = [] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] reserved_percentage = 0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] rpc_response_timeout = 120 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] run_external_periodic_tasks = True {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] scst_target_driver = iscsi {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] scst_target_iqn_name = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] service_down_time = 720 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] shell_completion = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] snapshot_name_template = snapshot-%s {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] split_loggers = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] state_path = /opt/stack/data/cinder {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] storage_availability_zone = nova {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] storage_protocol = iSCSI {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] syslog_log_facility = LOG_USER {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] target_helper = lioadm {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] target_ip_address = 192.168.122.165 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] target_port = 3260 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] target_protocol = iscsi {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] target_secondary_ip_addresses = [] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] trace_flags = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] transfer_api_class = cinder.transfer.api.API {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] transport_url = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] until_refresh = 0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] use_chap_auth = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] use_default_quota_class = True {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] use_journal = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] use_json = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] use_multipath_for_image_xfer = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] use_stderr = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] use_syslog = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] verify_glance_signatures = enabled {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] volume_api_class = cinder.volume.api.API {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] volume_backend_name = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] volume_clear = zero {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] volume_clear_ionice = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] volume_clear_size = 0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] volume_copy_bps_limit = 0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] volume_dd_blocksize = 1M {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] volume_name_template = volume-%s {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] volume_service_inithost_offload = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] volume_usage_audit_period = month {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] zoning_mode = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_concurrency.disable_process_locking = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.auth_section = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.auth_type = password {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.auth_version = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.cache = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.certfile = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.delay_auth_decision = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.http_connect_timeout = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.include_service_catalog = True {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.insecure = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.interface = public {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.keyfile = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.memcache_password = {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.memcache_username = {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.region_name = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.service_token_roles_required = True {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.service_type = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.token_cache_time = 300 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86585) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 04:31:39 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.quobyte [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 04:31:39 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.quobyte [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 04:31:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Running cmd (subprocess): mount.quobyte {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.165/identity {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.backend = dogpile.cache.null {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.backend_argument = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.backend_expiration_time = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.config_prefix = cache.oslo {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.debug_cache_backend = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.enable_retry_client = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.enable_socket_keepalive = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.enabled = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.expiration_time = 600 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.hashclient_retry_attempts = 2 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.memcache_dead_retry = 300 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.memcache_pool_maxsize = 10 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.memcache_sasl_enabled = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.password = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.proxies = [] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.redis_db = 0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.redis_sentinel_service_name = mymaster {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.redis_server = localhost:6379 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.retry_attempts = 2 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.retry_delay = 0.0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.socket_keepalive_count = 1 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.socket_keepalive_idle = 1 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.socket_keepalive_interval = 1 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.socket_timeout = 1.0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.tls_allowed_ciphers = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.tls_cafile = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.tls_certfile = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.tls_enabled = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.tls_keyfile = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cache.username = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] coordination.backend_url = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.asyncio_connection = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.asyncio_slave_connection = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.backend = sqlalchemy {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.connection = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.connection_debug = 0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.connection_parameters = {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.connection_recycle_time = 3600 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.connection_trace = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.db_inc_retry_interval = True {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.db_max_retries = 20 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.db_max_retry_interval = 10 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.db_retry_interval = 1 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.max_overflow = 50 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.max_pool_size = 5 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.max_retries = 10 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.mysql_wsrep_sync_wait = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.pool_timeout = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.retry_interval = 10 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.slave_connection = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.sqlite_synchronous = True {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.synchronous_reader = True {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] database.use_db_reconnect = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] profiler.connection_string = messaging:// {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] profiler.enabled = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] profiler.es_doc_type = notification {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] profiler.es_scroll_size = 10000 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] profiler.es_scroll_time = 2m {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] profiler.filter_error_trace = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] profiler.hmac_keys = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] profiler.sentinel_service_name = mymaster {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] profiler.socket_timeout = 0.1 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] profiler.trace_requests = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] profiler.trace_sqlalchemy = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] profiler_jaeger.process_tags = {} {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] profiler_jaeger.service_name_prefix = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] profiler_otlp.service_name_prefix = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_policy.enforce_new_defaults = True {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_policy.enforce_scope = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_policy.policy_default_rule = default {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_policy.policy_file = policy.yaml {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_policy.remote_timeout = 60.0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] privsep_osbrick.group = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] privsep_osbrick.helper_command = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] privsep_osbrick.user = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cinder_sys_admin.group = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cinder_sys_admin.helper_command = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] cinder_sys_admin.user = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] service_user.auth_section = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] service_user.auth_type = password {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] service_user.cafile = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] service_user.certfile = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] service_user.collect_timing = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] service_user.insecure = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] service_user.keyfile = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] service_user.send_service_user_token = True {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] service_user.split_loggers = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] service_user.timeout = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] glance.auth_section = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] glance.auth_type = password {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] glance.certfile = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] glance.collect_timing = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] glance.insecure = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] glance.keyfile = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] glance.region_name = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] glance.split_loggers = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] glance.timeout = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.backend_availability_zone = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.chap_password = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack quobyte-client[86586]: Reading configuration file: /etc/quobyte/client.cfg Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.chap_username = {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.disk_geometry = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack quobyte-client[86586]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.driver_client_cert = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.driver_client_cert_key = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.driver_data_namespace = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.driver_use_ssl = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.enable_unsupported_driver = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.extra_capabilities = {} {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.filter_function = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] CMD "mount.quobyte" returned: 1 in 0.105s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.goodness_function = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:31:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:31:39 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.iscsi_target_flags = {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.iscsi_write_cache = on {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.iser_helper = tgtadm {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86585]: INFO cinder.volume.drivers.quobyte [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 ... Jul 10 04:31:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 -c /etc/quobyte/client-cinder.cfg {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.iser_ip_address = 192.168.122.165 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.iser_port = 3260 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.nas_host = {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.nas_login = admin {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.nas_mount_options = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.nas_password = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.nas_private_key = {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.nas_share_path = {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.nas_ssh_port = 22 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.num_shell_tries = 3 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.nvmet_port_id = 1 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.quobyte_client_cfg = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.quobyte_volume_url = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.replication_device = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.report_discard_supported = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.reserved_percentage = 0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.scst_target_driver = iscsi {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.scst_target_iqn_name = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.storage_protocol = iSCSI {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.target_helper = tgtadm {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.target_ip_address = 192.168.122.165 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.target_port = 3260 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.target_protocol = iscsi {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.trace_flags = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.unique_fqdn_network = True {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.use_chap_auth = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.volume_backend_name = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.volume_clear = zero {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.volume_clear_ionice = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.volume_clear_size = 0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_reports.file_event_handler = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_reports.log_dir = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.backend_availability_zone = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.backend_host = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.chap_password = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.chap_username = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.chiscsi_conf = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.disk_geometry = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.driver_client_cert = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.driver_client_cert_key = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.driver_data_namespace = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.driver_use_ssl = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.extra_capabilities = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.filter_function = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.goodness_function = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.iscsi_target_flags = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.iscsi_write_cache = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.iser_helper = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.iser_ip_address = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.iser_port = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.iser_target_prefix = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.nas_host = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.nas_login = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.nas_mount_options = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.nas_password = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.nas_private_key = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.nas_share_path = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.nas_ssh_port = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.num_shell_tries = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 -c /etc/quobyte/client-cinder.cfg Jul 10 04:31:39 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.nvmet_ns_id = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.nvmet_port_id = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.replication_device = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.report_discard_supported = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.reserved_percentage = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.scst_target_driver = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.storage_protocol = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.target_helper = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.target_ip_address = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.target_port = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.target_prefix = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.target_protocol = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.trace_flags = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.unique_fqdn_network = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.use_chap_auth = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.volume_clear = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.volume_clear_ionice = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.volume_clear_size = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] QuobyteHD.volumes_dir = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.ssl = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.ssl_version = {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_notifications.driver = [] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_notifications.retry = -1 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] oslo_messaging_notifications.transport_url = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] key_manager.fixed_key = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican.barbican_api_version = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican.barbican_endpoint = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican.barbican_endpoint_type = public {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican.barbican_region_name = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican.cafile = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican.certfile = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican.collect_timing = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican.insecure = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican.keyfile = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican.number_of_retries = 60 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican.retry_delay = 1 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican.send_service_user_token = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican.split_loggers = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican.timeout = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican.verify_ssl = True {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican.verify_ssl_path = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican_service_user.auth_section = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican_service_user.auth_type = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican_service_user.cafile = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican_service_user.certfile = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican_service_user.collect_timing = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican_service_user.insecure = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican_service_user.keyfile = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican_service_user.split_loggers = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] barbican_service_user.timeout = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] vault.approle_role_id = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] vault.approle_secret_id = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] vault.kv_mountpoint = secret {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] vault.kv_path = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] vault.kv_version = 2 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] vault.namespace = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] vault.root_token_id = **** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] vault.ssl_ca_crt_file = None {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] vault.timeout = 60.0 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] vault.use_ssl = False {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:39 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] ******************************************************************************** {{(pid=86368) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 04:31:40 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Jul 10 04:31:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.834s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:31:40 devstack cinder-volume[86585]: INFO cinder.volume.drivers.quobyte [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 succeeded Jul 10 04:31:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:31:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.848s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:31:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:31:40 devstack sudo[86660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:31:40 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:31:40 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root Jul 10 04:31:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.620s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:31:40 devstack cinder-volume[86585]: INFO cinder.volume.driver [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 04:31:40 devstack cinder-volume[86585]: DEBUG cinder.volume.driver [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86585) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 04:31:41 devstack cinder-volume[86585]: DEBUG oslo_db.sqlalchemy.engines [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86585) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:31:41 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writer thread running {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 04:31:41 devstack cinder-volume[86585]: DEBUG cinder.db.api [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Building query based on filter {{(pid=86585) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 04:31:41 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86585) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1331}} Jul 10 04:31:41 devstack cinder-volume[86585]: INFO cinder.keymgr.migration [None req-6aba7f4b-4707-4342-9a68-c8adfba2cfa4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 04:31:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:31:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:31:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:31:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:31:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:31:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:31:41 devstack sudo[86664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:31:41 devstack sudo[86664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:31:41 devstack sudo[86664]: pam_unix(sudo:session): session closed for user root Jul 10 04:31:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.685s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:31:41 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:31:41 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Driver initialization completed successfully. Jul 10 04:31:41 devstack cinder-volume[86585]: INFO cinder.manager [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Initiating service 3 cleanup Jul 10 04:31:41 devstack cinder-volume[86585]: INFO cinder.manager [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Service 3 cleanup completed. Jul 10 04:31:41 devstack cinder-volume[86585]: DEBUG cinder.service [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Creating RPC server for service cinder-volume {{(pid=86585) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 04:31:41 devstack cinder-volume[86585]: DEBUG cinder.service [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86585) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 04:31:41 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 04:31:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:31:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:31:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:31:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:31:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:31:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:31:41 devstack sudo[86671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:31:41 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:31:42 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root Jul 10 04:31:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.738s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:31:42 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-d2fc468a-dcf0-4794-90fd-60915092f411 None None] Driver post RPC initialization completed successfully. Jul 10 04:31:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-99659db1-49fd-48a5-8b19-b49e1c2120bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:31:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-99659db1-49fd-48a5-8b19-b49e1c2120bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:31:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-99659db1-49fd-48a5-8b19-b49e1c2120bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:31:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-99659db1-49fd-48a5-8b19-b49e1c2120bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:31:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-99659db1-49fd-48a5-8b19-b49e1c2120bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:31:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-99659db1-49fd-48a5-8b19-b49e1c2120bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:31:46 devstack sudo[86824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:31:46 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:31:47 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root Jul 10 04:31:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-99659db1-49fd-48a5-8b19-b49e1c2120bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.633s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:31:47 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-99659db1-49fd-48a5-8b19-b49e1c2120bf None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:31:49 devstack cinder-volume[86368]: INFO oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Caught SIGTERM, stopping children Jul 10 04:31:49 devstack cinder-volume[86368]: DEBUG oslo_concurrency.lockutils [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Acquiring lock "singleton_lock" {{(pid=86368) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 04:31:49 devstack cinder-volume[86368]: DEBUG oslo_concurrency.lockutils [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Acquired lock "singleton_lock" {{(pid=86368) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 04:31:49 devstack cinder-volume[86368]: DEBUG oslo_concurrency.lockutils [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Releasing lock "singleton_lock" {{(pid=86368) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 04:31:49 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Stop services. {{(pid=86368) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 04:31:49 devstack cinder-volume[86368]: DEBUG oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Killing children. {{(pid=86368) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 04:31:49 devstack cinder-volume[86368]: INFO oslo_service.backend._eventlet.service [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Waiting on 1 children to exit Jul 10 04:31:51 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=3 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:31:52 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:31:54 devstack cinder-volume[86585]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 10 04:31:54 devstack cinder-volume[87063]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 04:31:54 devstack cinder-volume[87063]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 04:31:54 devstack cinder-volume[87063]: we strongly recommend against using it for new projects. Jul 10 04:31:54 devstack cinder-volume[87063]: If you are already using Eventlet, we recommend migrating to a different Jul 10 04:31:54 devstack cinder-volume[87063]: framework. For more detail see Jul 10 04:31:54 devstack cinder-volume[87063]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 04:31:54 devstack cinder-volume[87063]: import eventlet # noqa Jul 10 04:31:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Acquiring lock "singleton_lock" {{(pid=86585) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 04:31:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Acquired lock "singleton_lock" {{(pid=86585) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 04:31:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Releasing lock "singleton_lock" {{(pid=86585) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 04:31:55 devstack cinder-volume[86585]: WARNING amqp [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 04:31:55 devstack cinder-volume[86585]: WARNING amqp [None req-b1f6965f-1b9f-4e33-a99b-4caae437dfac None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 04:31:57 devstack cinder-volume[87063]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87063) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 04:31:57 devstack cinder-volume[87063]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87063) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 04:31:57 devstack cinder-volume[87063]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87063) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 04:31:57 devstack cinder-volume[87063]: INFO dbcounter [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] Registered counter for database cinder Jul 10 04:31:57 devstack cinder-volume[87063]: DEBUG oslo_db.sqlalchemy.engines [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87063) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG dbcounter [-] [87063] Writer thread running {{(pid=87063) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 04:31:58 devstack cinder-volume[87063]: INFO cinder.rpc [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 04:31:58 devstack cinder-volume[87063]: INFO cinder.rpc [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_db.sqlalchemy.engines [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87063) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:31:58 devstack cinder-volume[87063]: INFO cinder.volume.manager [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] Determined volume DB was empty at startup. Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG cinder.volume.manager [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87063) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 04:31:58 devstack cinder-volume[87063]: WARNING stevedore.named [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 04:31:58 devstack cinder-volume[87063]: WARNING castellan.key_manager [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 04:31:58 devstack cinder-volume[87063]: WARNING cinder.keymgr.conf_key_mgr [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 04:31:58 devstack cinder-volume[87063]: INFO cinder.volume.manager [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_db.sqlalchemy.engines [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87063) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:31:58 devstack cinder-volume[87063]: INFO oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] Starting 1 workers Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] Started child 87359 {{(pid=87063) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] Full set of CONF: {{(pid=87063) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] ******************************************************************************** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] Configuration options gathered from: {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] ================================================================================ {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] allow_availability_zone_fallback = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] allow_compression_on_image_upload = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] allowed_direct_url_schemes = [] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] api_rate_limit = True {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] auth_strategy = keystone {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_availability_zone = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_host = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_name = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87359]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_stats_polling_interval = 60 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backup_api_class = cinder.backup.api.API {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backup_name_template = backup-%s {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backup_use_same_host = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backup_use_temp_snapshot = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] chap_password = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] chap_username = {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cinder_internal_tenant_project_id = a61d86174d4b436fa8bccbd5fb51dcdb {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cinder_internal_tenant_user_id = e6041e31ff894bb8a5a1cbd34ef84b7d {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cluster = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] compression_format = gzip {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] compute_api_class = cinder.compute.nova.API {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] config_dir = [] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] config_source = [] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] control_exchange = openstack {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] debug = True {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] default_availability_zone = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] default_group_type = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] default_volume_type = QuobyteHD {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] disk_geometry = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] driver_client_cert = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] driver_client_cert_key = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] driver_data_namespace = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] driver_ssl_cert_path = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] driver_ssl_cert_verify = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] driver_use_ssl = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] enable_new_services = True {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] enable_unsupported_driver = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] enabled_backends = ['QuobyteHD'] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] enforce_multipath_for_image_xfer = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] filter_function = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] glance_api_insecure = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] glance_api_servers = ['http://192.168.122.165/image'] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] glance_api_ssl_compression = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] glance_ca_certificates_file = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] glance_catalog_info = image:glance:publicURL {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] glance_certfile = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] glance_keyfile = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] glance_num_retries = 3 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] glance_request_timeout = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] goodness_function = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] graceful_shutdown_timeout = 5 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] group_api_class = cinder.group.api.API {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] host = devstack {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] image_compress_on_upload = True {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] image_conversion_address_space_limit = 1 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] image_conversion_cpu_limit = 60 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] image_conversion_disable = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] image_upload_use_cinder_backend = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] image_upload_use_internal_tenant = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] image_volume_cache_enabled = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] image_volume_cache_max_count = 0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] image_volume_cache_max_size_gb = 0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] init_host_max_objects_retrieval = 0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] instance_format = [instance: %(uuid)s] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] iscsi_target_flags = {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] iscsi_write_cache = on {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] iser_helper = tgtadm {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] iser_ip_address = 192.168.122.165 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] iser_port = 3260 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] log_color = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] log_config_append = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] log_dir = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] log_file = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] log_options = True {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] log_rotate_interval = 1 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] log_rotate_interval_type = days {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] log_rotation_type = none {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] max_age = 0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] max_logfile_count = 30 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] max_logfile_size_mb = 200 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] max_over_subscription_ratio = 20.0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] message_reap_interval = 86400 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] message_ttl = 2592000 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] migration_create_volume_timeout_secs = 300 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] monkey_patch = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] monkey_patch_modules = [] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] my_ip = 192.168.122.165 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] no_snapshot_gb_quota = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] num_iser_scan_tries = 3 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] num_shell_tries = 3 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] num_volume_device_scan_tries = 3 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] nvmeof_conn_info_version = 1 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] nvmet_ns_id = 10 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] nvmet_port_id = 1 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] osapi_max_limit = 1000 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] osapi_volume_ext_list = [] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] osapi_volume_listen = 0.0.0.0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] osapi_volume_listen_port = 8776 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] osapi_volume_use_ssl = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] osapi_volume_workers = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] per_volume_size_limit = -1 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] periodic_fuzzy_delay = 60 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] periodic_interval = 60 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] project_id_regex = [0-9a-f\-]+ {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] public_endpoint = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] publish_errors = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] quota_backup_gigabytes = 1000 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] quota_backups = 10 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] quota_gigabytes = 1000 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] quota_groups = 10 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] quota_snapshots = 10 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] quota_volumes = 10 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] rate_limit_burst = 0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] rate_limit_except_level = CRITICAL {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] rate_limit_interval = 0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] reinit_driver_count = 3 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] replication_device = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] report_discard_supported = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] report_interval = 120 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] reservation_clean_interval = 86400 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] reservation_expire = 86400 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] reserved_image_namespaces = [] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] reserved_percentage = 0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] rpc_response_timeout = 120 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] run_external_periodic_tasks = True {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] scst_target_driver = iscsi {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] scst_target_iqn_name = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] service_down_time = 720 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] shell_completion = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] snapshot_name_template = snapshot-%s {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] split_loggers = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] state_path = /opt/stack/data/cinder {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] storage_availability_zone = nova {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] storage_protocol = iSCSI {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] syslog_log_facility = LOG_USER {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] target_helper = lioadm {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] target_ip_address = 192.168.122.165 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] target_port = 3260 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] target_protocol = iscsi {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87359) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] target_secondary_ip_addresses = [] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] trace_flags = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] transfer_api_class = cinder.transfer.api.API {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] transport_url = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] until_refresh = 0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] use_chap_auth = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] use_default_quota_class = True {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] use_journal = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] use_json = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] use_multipath_for_image_xfer = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] use_stderr = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] use_syslog = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] verify_glance_signatures = enabled {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] volume_api_class = cinder.volume.api.API {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] volume_backend_name = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] volume_clear = zero {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] volume_clear_ionice = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] volume_clear_size = 0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] volume_copy_bps_limit = 0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] volume_dd_blocksize = 1M {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] volume_name_template = volume-%s {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] volume_service_inithost_offload = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] volume_usage_audit_period = month {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] zoning_mode = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_concurrency.disable_process_locking = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.auth_section = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.auth_type = password {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.auth_version = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.cache = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.certfile = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.delay_auth_decision = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.http_connect_timeout = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.include_service_catalog = True {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.insecure = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.interface = public {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.keyfile = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.memcache_password = {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack quobyte-client[87363]: Reading configuration file: /etc/quobyte/client.cfg Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack quobyte-client[87363]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.memcache_username = {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.region_name = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.service_token_roles_required = True {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.service_type = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.token_cache_time = 300 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.165/identity {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.backend = dogpile.cache.null {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.backend_argument = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.backend_expiration_time = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.config_prefix = cache.oslo {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.debug_cache_backend = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.enable_retry_client = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.enable_socket_keepalive = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.enabled = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.expiration_time = 600 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.hashclient_retry_attempts = 2 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.memcache_dead_retry = 300 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.memcache_pool_maxsize = 10 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.memcache_sasl_enabled = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.password = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.proxies = [] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.redis_db = 0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.redis_sentinel_service_name = mymaster {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.redis_server = localhost:6379 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.retry_attempts = 2 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.retry_delay = 0.0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.socket_keepalive_count = 1 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.socket_keepalive_idle = 1 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.socket_keepalive_interval = 1 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.socket_timeout = 1.0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.tls_allowed_ciphers = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.tls_cafile = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.tls_certfile = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.tls_enabled = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.tls_keyfile = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cache.username = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] coordination.backend_url = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.asyncio_connection = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.asyncio_slave_connection = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.backend = sqlalchemy {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.connection = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.connection_debug = 0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.connection_parameters = {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.connection_recycle_time = 3600 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.connection_trace = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.db_inc_retry_interval = True {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.db_max_retries = 20 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.db_max_retry_interval = 10 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.db_retry_interval = 1 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.max_overflow = 50 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.max_pool_size = 5 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.max_retries = 10 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.mysql_wsrep_sync_wait = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.pool_timeout = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.retry_interval = 10 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.slave_connection = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.sqlite_synchronous = True {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.synchronous_reader = True {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] database.use_db_reconnect = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87359) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] profiler.connection_string = messaging:// {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.quobyte [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] profiler.enabled = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.quobyte [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] profiler.es_doc_type = notification {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] profiler.es_scroll_size = 10000 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] profiler.es_scroll_time = 2m {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] profiler.filter_error_trace = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Running cmd (subprocess): mount.quobyte {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] profiler.hmac_keys = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] profiler.sentinel_service_name = mymaster {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] profiler.socket_timeout = 0.1 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] profiler.trace_requests = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] profiler.trace_sqlalchemy = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] profiler_jaeger.process_tags = {} {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] profiler_jaeger.service_name_prefix = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] profiler_otlp.service_name_prefix = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_policy.enforce_new_defaults = True {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_policy.enforce_scope = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_policy.policy_default_rule = default {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_policy.policy_file = policy.yaml {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_policy.remote_timeout = 60.0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] privsep_osbrick.group = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] privsep_osbrick.helper_command = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] privsep_osbrick.user = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cinder_sys_admin.group = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cinder_sys_admin.helper_command = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] cinder_sys_admin.user = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] service_user.auth_section = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] service_user.auth_type = password {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] service_user.cafile = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] service_user.certfile = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] service_user.collect_timing = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] service_user.insecure = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] service_user.keyfile = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] service_user.send_service_user_token = True {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] service_user.split_loggers = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] service_user.timeout = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] glance.auth_section = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] glance.auth_type = password {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] glance.certfile = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] glance.collect_timing = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] glance.insecure = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] glance.keyfile = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] glance.region_name = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] glance.split_loggers = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] glance.timeout = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.backend_availability_zone = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.chap_password = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.chap_username = {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.disk_geometry = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.driver_client_cert = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.driver_client_cert_key = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.driver_data_namespace = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.driver_use_ssl = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.enable_unsupported_driver = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.extra_capabilities = {} {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.filter_function = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.goodness_function = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.iscsi_target_flags = {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.iscsi_write_cache = on {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.iser_helper = tgtadm {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.iser_ip_address = 192.168.122.165 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.iser_port = 3260 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.nas_host = {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.nas_login = admin {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.nas_mount_options = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.nas_password = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.nas_private_key = {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.nas_share_path = {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.nas_ssh_port = 22 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.num_shell_tries = 3 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.nvmet_port_id = 1 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.quobyte_client_cfg = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.quobyte_volume_url = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.replication_device = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.report_discard_supported = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.reserved_percentage = 0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.scst_target_driver = iscsi {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.scst_target_iqn_name = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.storage_protocol = iSCSI {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.target_helper = tgtadm {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.target_ip_address = 192.168.122.165 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.target_port = 3260 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.target_protocol = iscsi {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.trace_flags = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.unique_fqdn_network = True {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.use_chap_auth = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.volume_backend_name = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.volume_clear = zero {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.volume_clear_ionice = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.volume_clear_size = 0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_reports.file_event_handler = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_reports.log_dir = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.backend_availability_zone = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.backend_host = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.chap_password = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.chap_username = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.chiscsi_conf = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.disk_geometry = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.driver_client_cert = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.driver_client_cert_key = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.driver_data_namespace = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack sudo[87366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.driver_use_ssl = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.extra_capabilities = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.filter_function = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.goodness_function = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.iscsi_target_flags = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.iscsi_write_cache = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.iser_helper = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.iser_ip_address = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.iser_port = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.iser_target_prefix = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.nas_host = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.nas_login = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.nas_mount_options = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.nas_password = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.nas_private_key = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.nas_share_path = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.nas_ssh_port = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.num_shell_tries = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.nvmet_ns_id = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.nvmet_port_id = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] CMD "mount.quobyte" returned: 1 in 0.086s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.replication_device = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.report_discard_supported = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.reserved_percentage = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.scst_target_driver = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.storage_protocol = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.target_helper = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.target_ip_address = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.target_port = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.target_prefix = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.target_protocol = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.trace_flags = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.unique_fqdn_network = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.use_chap_auth = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.volume_clear = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.volume_clear_ionice = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.volume_clear_size = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] QuobyteHD.volumes_dir = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.ssl = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.ssl_version = {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_notifications.driver = [] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_notifications.retry = -1 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] oslo_messaging_notifications.transport_url = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] key_manager.fixed_key = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican.barbican_api_version = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican.barbican_endpoint = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican.barbican_endpoint_type = public {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican.barbican_region_name = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican.cafile = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican.certfile = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican.collect_timing = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican.insecure = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican.keyfile = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican.number_of_retries = 60 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican.retry_delay = 1 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican.send_service_user_token = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican.split_loggers = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican.timeout = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican.verify_ssl = True {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican.verify_ssl_path = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican_service_user.auth_section = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican_service_user.auth_type = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican_service_user.cafile = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican_service_user.certfile = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican_service_user.collect_timing = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican_service_user.insecure = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican_service_user.keyfile = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican_service_user.split_loggers = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] barbican_service_user.timeout = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] vault.approle_role_id = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] vault.approle_secret_id = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] vault.kv_mountpoint = secret {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] vault.kv_path = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] vault.kv_version = 2 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] vault.namespace = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] vault.root_token_id = **** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] vault.ssl_ca_crt_file = None {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] vault.timeout = 60.0 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] vault.use_ssl = False {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:58 devstack cinder-volume[87063]: DEBUG oslo_service.backend._eventlet.service [None req-7d3b1620-908f-4315-a6af-52596652a22d None None] ******************************************************************************** {{(pid=87063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 04:31:59 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root Jul 10 04:31:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.671s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:31:59 devstack cinder-volume[87359]: INFO cinder.volume.driver [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Driver hasn't implemented _init_vendor_properties() Jul 10 04:31:59 devstack cinder-volume[87359]: DEBUG cinder.volume.driver [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87359) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 04:31:59 devstack cinder-volume[87359]: DEBUG oslo_db.sqlalchemy.engines [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87359) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:31:59 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writer thread running {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 04:31:59 devstack cinder-volume[87359]: DEBUG cinder.db.api [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Building query based on filter {{(pid=87359) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 04:31:59 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87359) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1331}} Jul 10 04:31:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:31:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:31:59 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:31:59 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:31:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:31:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:31:59 devstack cinder-volume[87359]: INFO cinder.keymgr.migration [None req-19b676e3-1a61-47a2-803f-47e8dc771dde None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 04:31:59 devstack sudo[87370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:31:59 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:32:00 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root Jul 10 04:32:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.675s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:32:00 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:32:00 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Driver initialization completed successfully. Jul 10 04:32:00 devstack cinder-volume[87359]: INFO cinder.manager [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Initiating service 3 cleanup Jul 10 04:32:00 devstack cinder-volume[87359]: INFO cinder.manager [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Service 3 cleanup completed. Jul 10 04:32:00 devstack cinder-volume[87359]: DEBUG cinder.service [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Creating RPC server for service cinder-volume {{(pid=87359) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 04:32:00 devstack cinder-volume[87359]: DEBUG cinder.service [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87359) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 04:32:00 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 04:32:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:32:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:32:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:32:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:32:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:32:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:32:00 devstack sudo[87404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:32:00 devstack sudo[87404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:32:00 devstack sudo[87404]: pam_unix(sudo:session): session closed for user root Jul 10 04:32:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.611s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:32:00 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d5d42d1c-5a92-4177-a475-0c6559d6e13d None None] Driver post RPC initialization completed successfully. Jul 10 04:32:08 devstack cinder-volume[87063]: DEBUG dbcounter [-] [87063] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87063) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:32:10 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:32:10 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=3 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:32:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:32:15 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 6 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:32:15 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Flow 'volume_create_manager' (41a9fc9a-4d62-415d-8bba-bb8497d3391d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c14c0b2-54e6-42fd-b976-c3826ca10a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c14c0b2-54e6-42fd-b976-c3826ca10a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-880031529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bfc0788-5766-4c95-ae8b-ab90538014ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39f65b3af51b48528b245e30575c6103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:32:56Z,use_quota=True,user_id='dd07686837dd48a58a8b1d400398e114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ad53d1-7a8a-442d-9e06-05acf30bf290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ad53d1-7a8a-442d-9e06-05acf30bf290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd2d482-204f-44d7-9458-28ae62d776bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd2d482-204f-44d7-9458-28ae62d776bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bfc0788-5766-4c95-ae8b-ab90538014ad', 'volume_name': 'volume-9bfc0788-5766-4c95-ae8b-ab90538014ad', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7dc53c9-e31a-4737-b5b1-bdbff89f8f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7dc53c9-e31a-4737-b5b1-bdbff89f8f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff23172-f326-4b46-b133-66e4d1217cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:56 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Volume 9bfc0788-5766-4c95-ae8b-ab90538014ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bfc0788-5766-4c95-ae8b-ab90538014ad', 'volume_size': 1} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-880031529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bfc0788-5766-4c95-ae8b-ab90538014ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39f65b3af51b48528b245e30575c6103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:32:56Z,use_quota=True,user_id='dd07686837dd48a58a8b1d400398e114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Creating volume 9bfc0788-5766-4c95-ae8b-ab90538014ad {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:32:56 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9bfc0788-5766-4c95-ae8b-ab90538014ad 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:32:56 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9bfc0788-5766-4c95-ae8b-ab90538014ad 1073741824 Jul 10 04:32:56 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Flow 'volume_create_manager' (0e4877d7-16b6-4681-b498-18f854f07d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5ada5a-3b2e-4e37-adc5-fa6f6da45bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5ada5a-3b2e-4e37-adc5-fa6f6da45bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1363327212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='380613a9a63a4e589c8638d81a44fabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:32:56Z,use_quota=True,user_id='d6a528079ff74f34bb826b5fd0f6afcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07701c0-da7f-4818-9177-7264af4856aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07701c0-da7f-4818-9177-7264af4856aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86929e1-f027-40f3-af02-b8f95fdc10df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86929e1-f027-40f3-af02-b8f95fdc10df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e', 'volume_name': 'volume-2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef62bddb-3112-468e-9c13-8b3cec405f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef62bddb-3112-468e-9c13-8b3cec405f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f61603a2-c04f-48e5-9228-b4d86922e64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:56 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Volume 2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e', 'volume_size': 1} Jul 10 04:32:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:32:57 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Jul 10 04:32:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9bfc0788-5766-4c95-ae8b-ab90538014ad 1073741824" returned: 0 in 0.933s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:32:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9bfc0788-5766-4c95-ae8b-ab90538014ad {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:32:57 devstack sudo[87846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9bfc0788-5766-4c95-ae8b-ab90538014ad Jul 10 04:32:57 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:32:58 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root Jul 10 04:32:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9bfc0788-5766-4c95-ae8b-ab90538014ad" returned: 0 in 0.639s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:32:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:32:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:32:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.552s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:32:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1363327212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='380613a9a63a4e589c8638d81a44fabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:32:56Z,use_quota=True,user_id='d6a528079ff74f34bb826b5fd0f6afcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:32:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Creating volume 2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:32:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:32:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:32:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:32:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:32:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:32:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:32:58 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:32:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:32:58 devstack sudo[87852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e 1073741824 Jul 10 04:32:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff23172-f326-4b46-b133-66e4d1217cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bfc0788-5766-4c95-ae8b-ab90538014ad', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:32:58 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:32:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10c1d5a-b13e-4361-9516-446bffd2f4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:58 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Volume volume-9bfc0788-5766-4c95-ae8b-ab90538014ad (9bfc0788-5766-4c95-ae8b-ab90538014ad): created successfully Jul 10 04:32:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10c1d5a-b13e-4361-9516-446bffd2f4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:32:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Flow 'volume_create_manager' (41a9fc9a-4d62-415d-8bba-bb8497d3391d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:32:58 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-58449638-f700-4ceb-ae6e-e8122013a9e5 tempest-TaggedAttachmentsTest-405705856 None] Created volume successfully. Jul 10 04:32:59 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root Jul 10 04:32:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e 1073741824" returned: 0 in 0.935s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:32:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:32:59 devstack sudo[87864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e Jul 10 04:32:59 devstack sudo[87864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:32:59 devstack sudo[87864]: pam_unix(sudo:session): session closed for user root Jul 10 04:32:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e" returned: 0 in 0.806s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:32:59 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:32:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:32:59 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f61603a2-c04f-48e5-9228-b4d86922e64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:32:59 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af80cc69-bbeb-461a-8f22-82fe80caa147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:59 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Volume volume-2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e (2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e): created successfully Jul 10 04:32:59 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af80cc69-bbeb-461a-8f22-82fe80caa147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:32:59 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Flow 'volume_create_manager' (0e4877d7-16b6-4681-b498-18f854f07d54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:32:59 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-eff6a489-a710-4641-8384-a54346c7f1c4 tempest-VolumesTestJSON-1159674381 None] Created volume successfully. Jul 10 04:33:01 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:33:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Flow 'volume_create_manager' (9204780e-415f-4d12-acf5-c5cc26130b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:33:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf2202b-20f0-4cba-b7e2-95245c7010f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf2202b-20f0-4cba-b7e2-95245c7010f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1379419562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce094212-2044-4c56-a8b4-997d7e9d2447,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='380613a9a63a4e589c8638d81a44fabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:33:01Z,use_quota=True,user_id='d6a528079ff74f34bb826b5fd0f6afcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4027bbd-3323-4fc5-97be-87e741edd373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4027bbd-3323-4fc5-97be-87e741edd373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67f508a-68bf-480d-975e-9a48034952aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67f508a-68bf-480d-975e-9a48034952aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce094212-2044-4c56-a8b4-997d7e9d2447', 'volume_name': 'volume-ce094212-2044-4c56-a8b4-997d7e9d2447', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c6e56c-2143-4c5e-add9-08d4b4cb1520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c6e56c-2143-4c5e-add9-08d4b4cb1520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e15e8829-75ed-478a-9ce1-58f6cb1aeecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:01 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Volume ce094212-2044-4c56-a8b4-997d7e9d2447: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce094212-2044-4c56-a8b4-997d7e9d2447', 'volume_size': 1} Jul 10 04:33:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1379419562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce094212-2044-4c56-a8b4-997d7e9d2447,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='380613a9a63a4e589c8638d81a44fabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:33:01Z,use_quota=True,user_id='d6a528079ff74f34bb826b5fd0f6afcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:33:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Creating volume ce094212-2044-4c56-a8b4-997d7e9d2447 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:33:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:33:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:33:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:33:01 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:33:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce094212-2044-4c56-a8b4-997d7e9d2447 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:01 devstack sudo[87873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce094212-2044-4c56-a8b4-997d7e9d2447 1073741824 Jul 10 04:33:01 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:02 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce094212-2044-4c56-a8b4-997d7e9d2447 1073741824" returned: 0 in 0.955s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce094212-2044-4c56-a8b4-997d7e9d2447 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:02 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce094212-2044-4c56-a8b4-997d7e9d2447 Jul 10 04:33:02 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:02 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce094212-2044-4c56-a8b4-997d7e9d2447" returned: 0 in 0.780s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:33:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e15e8829-75ed-478a-9ce1-58f6cb1aeecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce094212-2044-4c56-a8b4-997d7e9d2447', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (382c7657-d02b-4a88-8883-d0f7dc5a49ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:03 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Volume volume-ce094212-2044-4c56-a8b4-997d7e9d2447 (ce094212-2044-4c56-a8b4-997d7e9d2447): created successfully Jul 10 04:33:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (382c7657-d02b-4a88-8883-d0f7dc5a49ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Flow 'volume_create_manager' (9204780e-415f-4d12-acf5-c5cc26130b4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:33:03 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ef03109c-32e2-4af7-8715-0de71351013f tempest-VolumesTestJSON-1159674381 None] Created volume successfully. Jul 10 04:33:04 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:33:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Flow 'volume_create_manager' (97b577c0-0d9a-499b-91df-132e84b16f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:33:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73658852-bd16-4311-a30f-cb9b464176c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73658852-bd16-4311-a30f-cb9b464176c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1770082772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfbd855c-a0b0-406f-85c4-ba19c16cf4eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='380613a9a63a4e589c8638d81a44fabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:33:04Z,use_quota=True,user_id='d6a528079ff74f34bb826b5fd0f6afcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f446bd4d-3e04-42a1-b54c-fb382ad8f48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f446bd4d-3e04-42a1-b54c-fb382ad8f48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b651b71-f56f-42d3-acf6-8d63734ca7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b651b71-f56f-42d3-acf6-8d63734ca7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfbd855c-a0b0-406f-85c4-ba19c16cf4eb', 'volume_name': 'volume-bfbd855c-a0b0-406f-85c4-ba19c16cf4eb', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432c32c5-b9ec-4468-870e-fd0f54ed6feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432c32c5-b9ec-4468-870e-fd0f54ed6feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9eb65a5-d9ed-4c9b-aa50-cc71171817ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:04 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Volume bfbd855c-a0b0-406f-85c4-ba19c16cf4eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfbd855c-a0b0-406f-85c4-ba19c16cf4eb', 'volume_size': 1} Jul 10 04:33:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:04 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1770082772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfbd855c-a0b0-406f-85c4-ba19c16cf4eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='380613a9a63a4e589c8638d81a44fabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:33:04Z,use_quota=True,user_id='d6a528079ff74f34bb826b5fd0f6afcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:33:04 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Creating volume bfbd855c-a0b0-406f-85c4-ba19c16cf4eb {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:33:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:04 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:33:04 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:33:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:04 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:33:04 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:33:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bfbd855c-a0b0-406f-85c4-ba19c16cf4eb 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:04 devstack sudo[87908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bfbd855c-a0b0-406f-85c4-ba19c16cf4eb 1073741824 Jul 10 04:33:04 devstack sudo[87908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:05 devstack sudo[87908]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bfbd855c-a0b0-406f-85c4-ba19c16cf4eb 1073741824" returned: 0 in 1.125s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bfbd855c-a0b0-406f-85c4-ba19c16cf4eb {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:05 devstack sudo[87918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bfbd855c-a0b0-406f-85c4-ba19c16cf4eb Jul 10 04:33:05 devstack sudo[87918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:06 devstack sudo[87918]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bfbd855c-a0b0-406f-85c4-ba19c16cf4eb" returned: 0 in 0.895s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] <== create_volume: return (2126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:33:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.130s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9eb65a5-d9ed-4c9b-aa50-cc71171817ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfbd855c-a0b0-406f-85c4-ba19c16cf4eb', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad436bde-1220-4193-aea1-4ce2e264b675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:06 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Volume volume-bfbd855c-a0b0-406f-85c4-ba19c16cf4eb (bfbd855c-a0b0-406f-85c4-ba19c16cf4eb): created successfully Jul 10 04:33:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad436bde-1220-4193-aea1-4ce2e264b675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Flow 'volume_create_manager' (97b577c0-0d9a-499b-91df-132e84b16f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:33:06 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-1809bcd5-f61a-4f3e-a830-793fad23d773 tempest-VolumesTestJSON-1159674381 None] Created volume successfully. Jul 10 04:33:09 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] Acquiring lock "cinder-bfbd855c-a0b0-406f-85c4-ba19c16cf4eb-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:33:09 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] Lock "cinder-bfbd855c-a0b0-406f-85c4-ba19c16cf4eb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:33:09 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] Acquiring lock "cinder-quobyte-bfbd855c-a0b0-406f-85c4-ba19c16cf4eb" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:33:09 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] Lock "cinder-quobyte-bfbd855c-a0b0-406f-85c4-ba19c16cf4eb" acquired by "delete_volume" :: waited 0.035s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:33:09 devstack cinder-volume[87359]: INFO oslo.privsep.daemon [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqe8682yr/privsep.sock'] Jul 10 04:33:09 devstack sudo[87985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqe8682yr/privsep.sock Jul 10 04:33:09 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:09 devstack cinder-volume[87359]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 10 04:33:09 devstack cinder-volume[87359]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 04:33:09 devstack cinder-volume[87359]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 04:33:09 devstack cinder-volume[87359]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 04:33:09 devstack cinder-volume[87359]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 04:33:09 devstack cinder-volume[87359]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 04:33:09 devstack cinder-volume[87359]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 04:33:09 devstack cinder-volume[87359]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 04:33:09 devstack cinder-volume[87359]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 10 04:33:10 devstack cinder-volume[87359]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 10 04:33:10 devstack cinder-volume[87359]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 04:33:10 devstack cinder-volume[87359]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 04:33:10 devstack cinder-volume[87359]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 04:33:10 devstack cinder-volume[87359]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 04:33:10 devstack cinder-volume[87359]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 04:33:10 devstack cinder-volume[87359]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 04:33:10 devstack cinder-volume[87359]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 04:33:10 devstack cinder-volume[87359]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 10 04:33:10 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:10 devstack cinder-volume[87359]: INFO oslo.privsep.daemon [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] Spawned new privsep daemon via rootwrap Jul 10 04:33:10 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] Accepted privsep connection to /tmp/tmpqe8682yr/privsep.sock {{(pid=87359) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 10 04:33:10 devstack cinder-volume[87359]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 10 04:33:10 devstack cinder-volume[87359]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 10 04:33:10 devstack cinder-volume[87359]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 10 04:33:10 devstack cinder-volume[87359]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88002 Jul 10 04:33:10 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[62985d7b-fe9a-4624-89e6-c25ab5305012]: (2,) {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:33:10 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc03492-ef28-407e-a5c1-2a5d2f870b9d]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:33:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bfbd855c-a0b0-406f-85c4-ba19c16cf4eb {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:11 devstack sudo[88014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bfbd855c-a0b0-406f-85c4-ba19c16cf4eb Jul 10 04:33:11 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:11 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bfbd855c-a0b0-406f-85c4-ba19c16cf4eb" returned: 0 in 0.942s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bfbd855c-a0b0-406f-85c4-ba19c16cf4eb {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:11 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bfbd855c-a0b0-406f-85c4-ba19c16cf4eb Jul 10 04:33:11 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:12 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bfbd855c-a0b0-406f-85c4-ba19c16cf4eb" returned: 0 in 0.810s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:12 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] Lock "cinder-quobyte-bfbd855c-a0b0-406f-85c4-ba19c16cf4eb" released by "delete_volume" :: held 3.635s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:33:12 devstack cinder-volume[87359]: WARNING cinder.quota [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:33:12 devstack cinder-volume[87359]: WARNING cinder.quota [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:33:12 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] Created reservations ['e4393ad4-d462-4c31-b9a2-3ae19a21d1e6', '13d62efc-aa8a-4752-be2f-067085fc7374', '25be38eb-cc01-4f61-a060-aba5e913aa4a', '962740d2-0386-48d8-b62b-0348742ef185'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:33:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:33:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:33:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:13 devstack sudo[88065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:33:13 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c8fc5174-b5c6-4058-95ad-c9a7b171a01b tempest-VolumesTestJSON-1159674381 None] Acquiring lock "cinder-ce094212-2044-4c56-a8b4-997d7e9d2447-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:33:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c8fc5174-b5c6-4058-95ad-c9a7b171a01b tempest-VolumesTestJSON-1159674381 None] Lock "cinder-ce094212-2044-4c56-a8b4-997d7e9d2447-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:33:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c8fc5174-b5c6-4058-95ad-c9a7b171a01b tempest-VolumesTestJSON-1159674381 None] Acquiring lock "cinder-quobyte-ce094212-2044-4c56-a8b4-997d7e9d2447" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:33:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c8fc5174-b5c6-4058-95ad-c9a7b171a01b tempest-VolumesTestJSON-1159674381 None] Lock "cinder-quobyte-ce094212-2044-4c56-a8b4-997d7e9d2447" acquired by "delete_volume" :: waited 0.031s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:33:14 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cfd7b1-af76-47b7-91ff-a92830643636]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:33:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c8fc5174-b5c6-4058-95ad-c9a7b171a01b tempest-VolumesTestJSON-1159674381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce094212-2044-4c56-a8b4-997d7e9d2447 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:14 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce094212-2044-4c56-a8b4-997d7e9d2447 Jul 10 04:33:14 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:14 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.909s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:14 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:33:14 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] Deleted volume successfully. Jul 10 04:33:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0826cc1a-a22e-4b19-87b8-88390376c3b4 tempest-VolumesTestJSON-1159674381 None] Lock "cinder-bfbd855c-a0b0-406f-85c4-ba19c16cf4eb-delete_volume" released by "delete_volume" :: held 5.940s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:33:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:33:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:33:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:33:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:15 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:33:15 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:16 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c8fc5174-b5c6-4058-95ad-c9a7b171a01b tempest-VolumesTestJSON-1159674381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce094212-2044-4c56-a8b4-997d7e9d2447" returned: 0 in 2.497s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c8fc5174-b5c6-4058-95ad-c9a7b171a01b tempest-VolumesTestJSON-1159674381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce094212-2044-4c56-a8b4-997d7e9d2447 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:16 devstack sudo[88114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce094212-2044-4c56-a8b4-997d7e9d2447 Jul 10 04:33:16 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:17 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.986s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:17 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:33:17 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:33:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 8 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:33:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:33:17 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c8fc5174-b5c6-4058-95ad-c9a7b171a01b tempest-VolumesTestJSON-1159674381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce094212-2044-4c56-a8b4-997d7e9d2447" returned: 0 in 1.391s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:17 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c8fc5174-b5c6-4058-95ad-c9a7b171a01b tempest-VolumesTestJSON-1159674381 None] Lock "cinder-quobyte-ce094212-2044-4c56-a8b4-997d7e9d2447" released by "delete_volume" :: held 3.968s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:33:18 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-c8fc5174-b5c6-4058-95ad-c9a7b171a01b tempest-VolumesTestJSON-1159674381 None] Created reservations ['0e57b2df-1ba5-4bfd-8389-9ce7a9e5d409', 'd1a37352-6d17-4eec-a54f-ebf9dd1d5473', '06467c65-4af2-48ed-9239-3323829e6416', '0d561594-cba2-49b5-8a78-ba9b02bc0d0e'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:33:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c8fc5174-b5c6-4058-95ad-c9a7b171a01b tempest-VolumesTestJSON-1159674381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c8fc5174-b5c6-4058-95ad-c9a7b171a01b tempest-VolumesTestJSON-1159674381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c8fc5174-b5c6-4058-95ad-c9a7b171a01b tempest-VolumesTestJSON-1159674381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:33:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c8fc5174-b5c6-4058-95ad-c9a7b171a01b tempest-VolumesTestJSON-1159674381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:33:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c8fc5174-b5c6-4058-95ad-c9a7b171a01b tempest-VolumesTestJSON-1159674381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c8fc5174-b5c6-4058-95ad-c9a7b171a01b tempest-VolumesTestJSON-1159674381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:18 devstack sudo[88125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:33:18 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3d0d5ab5-3971-46a2-a309-e9e224de884d tempest-VolumesTestJSON-1159674381 None] Acquiring lock "cinder-2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:33:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3d0d5ab5-3971-46a2-a309-e9e224de884d tempest-VolumesTestJSON-1159674381 None] Lock "cinder-2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:33:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3d0d5ab5-3971-46a2-a309-e9e224de884d tempest-VolumesTestJSON-1159674381 None] Acquiring lock "cinder-quobyte-2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:33:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3d0d5ab5-3971-46a2-a309-e9e224de884d tempest-VolumesTestJSON-1159674381 None] Lock "cinder-quobyte-2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e" acquired by "delete_volume" :: waited 0.052s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:33:18 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d1059d-ab21-426a-b27f-9974aeb42c4e]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:33:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3d0d5ab5-3971-46a2-a309-e9e224de884d tempest-VolumesTestJSON-1159674381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:18 devstack sudo[88127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e Jul 10 04:33:18 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:19 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c8fc5174-b5c6-4058-95ad-c9a7b171a01b tempest-VolumesTestJSON-1159674381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.286s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-c8fc5174-b5c6-4058-95ad-c9a7b171a01b tempest-VolumesTestJSON-1159674381 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:33:19 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c8fc5174-b5c6-4058-95ad-c9a7b171a01b tempest-VolumesTestJSON-1159674381 None] Deleted volume successfully. Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c8fc5174-b5c6-4058-95ad-c9a7b171a01b tempest-VolumesTestJSON-1159674381 None] Lock "cinder-ce094212-2044-4c56-a8b4-997d7e9d2447-delete_volume" released by "delete_volume" :: held 5.718s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Flow 'volume_create_manager' (7760fc7b-2c13-4791-8559-9e06b53c07a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae2ce318-18aa-40e0-99b4-10cf6bdede2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae2ce318-18aa-40e0-99b4-10cf6bdede2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-98598747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee53375f-ddf6-47f0-90b9-954ffd2b7c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24b55e21f2e04e158206fe88c0e04894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:33:20Z,use_quota=True,user_id='747d2ff935cc48948858ff94d1b37cc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e42f886-b8eb-47a7-94f1-a7134213f32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e42f886-b8eb-47a7-94f1-a7134213f32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36339b64-42bb-4cba-97d7-912bdd0d089b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36339b64-42bb-4cba-97d7-912bdd0d089b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee53375f-ddf6-47f0-90b9-954ffd2b7c0b', 'volume_name': 'volume-ee53375f-ddf6-47f0-90b9-954ffd2b7c0b', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33df235d-4b35-4aa1-899d-cf99446a0f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33df235d-4b35-4aa1-899d-cf99446a0f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0401ede-3605-41c3-9818-1ddec5bbc24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:19 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Volume ee53375f-ddf6-47f0-90b9-954ffd2b7c0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee53375f-ddf6-47f0-90b9-954ffd2b7c0b', 'volume_size': 1} Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-98598747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee53375f-ddf6-47f0-90b9-954ffd2b7c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24b55e21f2e04e158206fe88c0e04894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:33:20Z,use_quota=True,user_id='747d2ff935cc48948858ff94d1b37cc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Creating volume ee53375f-ddf6-47f0-90b9-954ffd2b7c0b {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:33:19 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:33:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ee53375f-ddf6-47f0-90b9-954ffd2b7c0b 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:19 devstack sudo[88136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ee53375f-ddf6-47f0-90b9-954ffd2b7c0b 1073741824 Jul 10 04:33:19 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:20 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3d0d5ab5-3971-46a2-a309-e9e224de884d tempest-VolumesTestJSON-1159674381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e" returned: 0 in 1.997s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3d0d5ab5-3971-46a2-a309-e9e224de884d tempest-VolumesTestJSON-1159674381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:20 devstack sudo[88161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e Jul 10 04:33:20 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:21 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ee53375f-ddf6-47f0-90b9-954ffd2b7c0b 1073741824" returned: 0 in 1.510s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ee53375f-ddf6-47f0-90b9-954ffd2b7c0b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:21 devstack sudo[88183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ee53375f-ddf6-47f0-90b9-954ffd2b7c0b Jul 10 04:33:21 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:21 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3d0d5ab5-3971-46a2-a309-e9e224de884d tempest-VolumesTestJSON-1159674381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e" returned: 0 in 1.417s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:21 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3d0d5ab5-3971-46a2-a309-e9e224de884d tempest-VolumesTestJSON-1159674381 None] Lock "cinder-quobyte-2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e" released by "delete_volume" :: held 3.527s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:33:22 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-3d0d5ab5-3971-46a2-a309-e9e224de884d tempest-VolumesTestJSON-1159674381 None] Created reservations ['62188b24-b2fe-4b45-a077-38ec17d4fe41', '4eef3f99-5287-4ca4-a545-7689481e47f2', 'b482b8fc-c152-4172-9d74-54bc29fac197', 'feb1e79d-3087-4a4f-a116-0c016b6ee095'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:33:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3d0d5ab5-3971-46a2-a309-e9e224de884d tempest-VolumesTestJSON-1159674381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3d0d5ab5-3971-46a2-a309-e9e224de884d tempest-VolumesTestJSON-1159674381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3d0d5ab5-3971-46a2-a309-e9e224de884d tempest-VolumesTestJSON-1159674381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:33:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3d0d5ab5-3971-46a2-a309-e9e224de884d tempest-VolumesTestJSON-1159674381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:33:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3d0d5ab5-3971-46a2-a309-e9e224de884d tempest-VolumesTestJSON-1159674381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3d0d5ab5-3971-46a2-a309-e9e224de884d tempest-VolumesTestJSON-1159674381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:22 devstack sudo[88198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:33:22 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:22 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ee53375f-ddf6-47f0-90b9-954ffd2b7c0b" returned: 0 in 1.136s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] <== create_volume: return (2727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:33:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.733s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0401ede-3605-41c3-9818-1ddec5bbc24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee53375f-ddf6-47f0-90b9-954ffd2b7c0b', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3b9f9c-2c50-42bc-8d0b-3d797b2e94bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:22 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Volume volume-ee53375f-ddf6-47f0-90b9-954ffd2b7c0b (ee53375f-ddf6-47f0-90b9-954ffd2b7c0b): created successfully Jul 10 04:33:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3b9f9c-2c50-42bc-8d0b-3d797b2e94bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Flow 'volume_create_manager' (7760fc7b-2c13-4791-8559-9e06b53c07a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:33:22 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c497de18-48c8-4a2a-81b7-33d24355acde tempest-VolumesAdminNegativeTest-2031073020 None] Created volume successfully. Jul 10 04:33:24 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3d0d5ab5-3971-46a2-a309-e9e224de884d tempest-VolumesTestJSON-1159674381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.789s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:24 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-3d0d5ab5-3971-46a2-a309-e9e224de884d tempest-VolumesTestJSON-1159674381 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:33:24 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-3d0d5ab5-3971-46a2-a309-e9e224de884d tempest-VolumesTestJSON-1159674381 None] Deleted volume successfully. Jul 10 04:33:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3d0d5ab5-3971-46a2-a309-e9e224de884d tempest-VolumesTestJSON-1159674381 None] Lock "cinder-2f6d1b4e-faeb-45c6-ab3a-c5ae5d63789e-delete_volume" released by "delete_volume" :: held 5.823s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:33:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-89a06ecf-d001-4750-8953-eb39d075194a tempest-VolumesAdminNegativeTest-2031073020 None] Acquiring lock "cinder-ee53375f-ddf6-47f0-90b9-954ffd2b7c0b-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:33:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-89a06ecf-d001-4750-8953-eb39d075194a tempest-VolumesAdminNegativeTest-2031073020 None] Lock "cinder-ee53375f-ddf6-47f0-90b9-954ffd2b7c0b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:33:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-89a06ecf-d001-4750-8953-eb39d075194a tempest-VolumesAdminNegativeTest-2031073020 None] Acquiring lock "cinder-quobyte-ee53375f-ddf6-47f0-90b9-954ffd2b7c0b" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:33:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-89a06ecf-d001-4750-8953-eb39d075194a tempest-VolumesAdminNegativeTest-2031073020 None] Lock "cinder-quobyte-ee53375f-ddf6-47f0-90b9-954ffd2b7c0b" acquired by "delete_volume" :: waited 0.056s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:33:24 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5077d2-3e18-4c5b-9d89-cf9eac3eae3c]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:33:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89a06ecf-d001-4750-8953-eb39d075194a tempest-VolumesAdminNegativeTest-2031073020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ee53375f-ddf6-47f0-90b9-954ffd2b7c0b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:24 devstack sudo[88248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ee53375f-ddf6-47f0-90b9-954ffd2b7c0b Jul 10 04:33:24 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:25 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89a06ecf-d001-4750-8953-eb39d075194a tempest-VolumesAdminNegativeTest-2031073020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ee53375f-ddf6-47f0-90b9-954ffd2b7c0b" returned: 0 in 1.102s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89a06ecf-d001-4750-8953-eb39d075194a tempest-VolumesAdminNegativeTest-2031073020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ee53375f-ddf6-47f0-90b9-954ffd2b7c0b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:25 devstack sudo[88255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ee53375f-ddf6-47f0-90b9-954ffd2b7c0b Jul 10 04:33:25 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:26 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89a06ecf-d001-4750-8953-eb39d075194a tempest-VolumesAdminNegativeTest-2031073020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ee53375f-ddf6-47f0-90b9-954ffd2b7c0b" returned: 0 in 0.960s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:26 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-89a06ecf-d001-4750-8953-eb39d075194a tempest-VolumesAdminNegativeTest-2031073020 None] Lock "cinder-quobyte-ee53375f-ddf6-47f0-90b9-954ffd2b7c0b" released by "delete_volume" :: held 2.151s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:33:26 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-89a06ecf-d001-4750-8953-eb39d075194a tempest-VolumesAdminNegativeTest-2031073020 None] Created reservations ['4a474e68-fe19-480f-9eea-4b010eb779e6', '18050825-156c-46c8-a44f-14c45cf15f64', 'f924e2e2-9887-4747-8d1a-e944c3b65b36', 'a500495d-2095-43d9-adb8-1ee387b85b98'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:33:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-89a06ecf-d001-4750-8953-eb39d075194a tempest-VolumesAdminNegativeTest-2031073020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-89a06ecf-d001-4750-8953-eb39d075194a tempest-VolumesAdminNegativeTest-2031073020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-89a06ecf-d001-4750-8953-eb39d075194a tempest-VolumesAdminNegativeTest-2031073020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:33:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-89a06ecf-d001-4750-8953-eb39d075194a tempest-VolumesAdminNegativeTest-2031073020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:33:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-89a06ecf-d001-4750-8953-eb39d075194a tempest-VolumesAdminNegativeTest-2031073020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89a06ecf-d001-4750-8953-eb39d075194a tempest-VolumesAdminNegativeTest-2031073020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:26 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:33:26 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:28 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89a06ecf-d001-4750-8953-eb39d075194a tempest-VolumesAdminNegativeTest-2031073020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.351s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:28 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-89a06ecf-d001-4750-8953-eb39d075194a tempest-VolumesAdminNegativeTest-2031073020 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:33:28 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-89a06ecf-d001-4750-8953-eb39d075194a tempest-VolumesAdminNegativeTest-2031073020 None] Deleted volume successfully. Jul 10 04:33:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-89a06ecf-d001-4750-8953-eb39d075194a tempest-VolumesAdminNegativeTest-2031073020 None] Lock "cinder-ee53375f-ddf6-47f0-90b9-954ffd2b7c0b-delete_volume" released by "delete_volume" :: held 3.994s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:33:32 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-1b99e44a-d0d2-43ef-9cab-83843d54f1e3 tempest-GroupSnapshotsTest-830225659 None] Group tempest-GroupSnapshotsTest-Group-2052269988: creating Jul 10 04:33:32 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-1b99e44a-d0d2-43ef-9cab-83843d54f1e3 tempest-GroupSnapshotsTest-830225659 None] Group tempest-GroupSnapshotsTest-Group-2052269988: created successfully Jul 10 04:33:32 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-1b99e44a-d0d2-43ef-9cab-83843d54f1e3 tempest-GroupSnapshotsTest-830225659 None] Create group completed successfully. Jul 10 04:33:34 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:33:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Flow 'volume_create_manager' (eebfe86b-7596-45ba-877f-a09ea80dbb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:33:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ae5d19-b82b-4e11-ac03-02d8a07f2802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ae5d19-b82b-4e11-ac03-02d8a07f2802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-446613275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=863629d9-2cd2-41ec-990a-daf32e356c72,host='devstack@QuobyteHD#QuobyteHD',id=e4c8baed-b3e6-4702-9f6f-0074a542d5ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5783e30b805c46b88521741eaa5c6c7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:33:34Z,use_quota=True,user_id='db465a938a7f4101ae320ff16479b382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(daf39655-1544-48af-a61f-66faa5703f3a),volume_type_id=daf39655-1544-48af-a61f-66faa5703f3a)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33068b41-2bfb-499e-970b-1a260866f4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33068b41-2bfb-499e-970b-1a260866f4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ec1953-20f0-4c40-9320-c7a107b58d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ec1953-20f0-4c40-9320-c7a107b58d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4c8baed-b3e6-4702-9f6f-0074a542d5ed', 'volume_name': 'volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7a77d6-5cec-4589-8ee9-2624e790d6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7a77d6-5cec-4589-8ee9-2624e790d6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84f121a-71ba-4e89-adce-30c865071204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:34 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Volume e4c8baed-b3e6-4702-9f6f-0074a542d5ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed', 'volume_size': 1} Jul 10 04:33:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=863629d9-2cd2-41ec-990a-daf32e356c72,created_at=2026-07-10T02:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-446613275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=863629d9-2cd2-41ec-990a-daf32e356c72,host='devstack@QuobyteHD#QuobyteHD',id=e4c8baed-b3e6-4702-9f6f-0074a542d5ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5783e30b805c46b88521741eaa5c6c7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:33:34Z,use_quota=True,user_id='db465a938a7f4101ae320ff16479b382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(daf39655-1544-48af-a61f-66faa5703f3a),volume_type_id=daf39655-1544-48af-a61f-66faa5703f3a)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:33:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Creating volume e4c8baed-b3e6-4702-9f6f-0074a542d5ed {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:33:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:33:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:33:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:33:34 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:33:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:34 devstack sudo[88320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed 1073741824 Jul 10 04:33:34 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:35 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed 1073741824" returned: 0 in 1.154s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:35 devstack sudo[88328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed Jul 10 04:33:35 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:36 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed" returned: 0 in 0.977s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:36 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] <== create_volume: return (2251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:33:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.254s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84f121a-71ba-4e89-adce-30c865071204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b193a74b-8ab1-40de-93be-c8e8e3680447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:36 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Volume volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed (e4c8baed-b3e6-4702-9f6f-0074a542d5ed): created successfully Jul 10 04:33:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b193a74b-8ab1-40de-93be-c8e8e3680447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Flow 'volume_create_manager' (eebfe86b-7596-45ba-877f-a09ea80dbb0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:33:36 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c4c205cb-8c97-469a-bed3-89181e404c34 tempest-GroupSnapshotsTest-830225659 None] Created volume successfully. Jul 10 04:33:38 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-be4ca89f-44b4-4d9d-b38e-1edcc0078de9 tempest-GroupSnapshotsTest-830225659 None] GroupSnapshot 6f6bb2da-94f1-4bf1-aab1-95722790054e: creating. Jul 10 04:33:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-be4ca89f-44b4-4d9d-b38e-1edcc0078de9 tempest-GroupSnapshotsTest-830225659 None] Group snapshot 6f6bb2da-94f1-4bf1-aab1-95722790054e: creating. {{(pid=87359) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4226}} Jul 10 04:33:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-be4ca89f-44b4-4d9d-b38e-1edcc0078de9 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-be4ca89f-44b4-4d9d-b38e-1edcc0078de9 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:38 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-be4ca89f-44b4-4d9d-b38e-1edcc0078de9 tempest-GroupSnapshotsTest-830225659 None] Creating offline snapshot eb9f12aa-80d6-4f93-b6d8-e229973294dc of volume e4c8baed-b3e6-4702-9f6f-0074a542d5ed {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:33:38 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d347f4-ca05-4ff1-b3e8-7ab3868da635]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:33:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-be4ca89f-44b4-4d9d-b38e-1edcc0078de9 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:38 devstack sudo[88334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed Jul 10 04:33:38 devstack sudo[88334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:39 devstack sudo[88334]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-be4ca89f-44b4-4d9d-b38e-1edcc0078de9 tempest-GroupSnapshotsTest-830225659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed" returned: 0 in 1.186s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-be4ca89f-44b4-4d9d-b38e-1edcc0078de9 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:39 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc 1G Jul 10 04:33:39 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:41 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-be4ca89f-44b4-4d9d-b38e-1edcc0078de9 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc 1G" returned: 0 in 1.188s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-be4ca89f-44b4-4d9d-b38e-1edcc0078de9 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:41 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc Jul 10 04:33:41 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:42 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-be4ca89f-44b4-4d9d-b38e-1edcc0078de9 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc" returned: 0 in 1.086s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:42 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-be4ca89f-44b4-4d9d-b38e-1edcc0078de9 tempest-GroupSnapshotsTest-830225659 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:33:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-be4ca89f-44b4-4d9d-b38e-1edcc0078de9 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:42 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc Jul 10 04:33:42 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:43 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-be4ca89f-44b4-4d9d-b38e-1edcc0078de9 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc" returned: 0 in 0.916s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-be4ca89f-44b4-4d9d-b38e-1edcc0078de9 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:43 devstack sudo[88398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.info Jul 10 04:33:43 devstack sudo[88398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:43 devstack sudo[88398]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-be4ca89f-44b4-4d9d-b38e-1edcc0078de9 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.info" returned: 0 in 0.784s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:43 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-be4ca89f-44b4-4d9d-b38e-1edcc0078de9 tempest-GroupSnapshotsTest-830225659 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:33:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-be4ca89f-44b4-4d9d-b38e-1edcc0078de9 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:43 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.info Jul 10 04:33:43 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:44 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-be4ca89f-44b4-4d9d-b38e-1edcc0078de9 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.info" returned: 0 in 0.683s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-be4ca89f-44b4-4d9d-b38e-1edcc0078de9 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.986s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:44 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-be4ca89f-44b4-4d9d-b38e-1edcc0078de9 tempest-GroupSnapshotsTest-830225659 None] group_snapshot 6f6bb2da-94f1-4bf1-aab1-95722790054e: created successfully Jul 10 04:33:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:46 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "cinder-quobyte-eb9f12aa-80d6-4f93-b6d8-e229973294dc-c8d06dfc-e0f9-41f9-b675-bc904b305d6b" by "_create_volume_from_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:33:46 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-eb9f12aa-80d6-4f93-b6d8-e229973294dc-c8d06dfc-e0f9-41f9-b675-bc904b305d6b" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:33:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Creating volume c8d06dfc-e0f9-41f9-b675-bc904b305d6b from snapshot eb9f12aa-80d6-4f93-b6d8-e229973294dc {{(pid=87359) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 04:33:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:33:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:33:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:33:46 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "cinder-quobyte-c8d06dfc-e0f9-41f9-b675-bc904b305d6b" by "_copy_volume_from_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:33:46 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-c8d06dfc-e0f9-41f9-b675-bc904b305d6b" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:33:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] snapshot: eb9f12aa-80d6-4f93-b6d8-e229973294dc, volume: c8d06dfc-e0f9-41f9-b675-bc904b305d6b, {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 04:33:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:33:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:33:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:46 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77551fd-56f6-4b6e-960e-80ee8fe7cdeb]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:33:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:46 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc Jul 10 04:33:46 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:47 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc" returned: 0 in 0.977s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:33:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 04:33:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Creating direct copy from snapshot {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 04:33:47 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2a4549-4315-44c1-a151-606bfafbb780]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:33:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:47 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed Jul 10 04:33:47 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:48 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed" returned: 0 in 1.001s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:48 devstack cinder-volume[87359]: DEBUG cinder.utils [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Path /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c8d06dfc-e0f9-41f9-b675-bc904b305d6b not found in is_blk_device check {{(pid=87359) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 04:33:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c8d06dfc-e0f9-41f9-b675-bc904b305d6b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:48 devstack sudo[88427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c8d06dfc-e0f9-41f9-b675-bc904b305d6b Jul 10 04:33:48 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:55 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c8d06dfc-e0f9-41f9-b675-bc904b305d6b" returned: 0 in 7.426s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:55 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbe5eb9-7ac6-45a1-8363-235ab927e7f6]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:33:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:55 devstack sudo[88532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed Jul 10 04:33:55 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:56 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=53,cinder:SELECT=34,cinder:DELETE=8,cinder:INSERT=9 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:33:56 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=50,cinder:UPDATE=53,cinder:INSERT=14,cinder:DELETE=2 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:33:56 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed" returned: 0 in 1.195s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:56 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed, size 1024.00 MB, duration 7.43 sec, destination /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c8d06dfc-e0f9-41f9-b675-bc904b305d6b {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:33:56 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Converted 1024.00 MB image at 137.87 MB/s Jul 10 04:33:56 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c8d06dfc-e0f9-41f9-b675-bc904b305d6b is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:33:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c8d06dfc-e0f9-41f9-b675-bc904b305d6b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:57 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c8d06dfc-e0f9-41f9-b675-bc904b305d6b Jul 10 04:33:57 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:57 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c8d06dfc-e0f9-41f9-b675-bc904b305d6b" returned: 0 in 0.789s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-c8d06dfc-e0f9-41f9-b675-bc904b305d6b" released by "_copy_volume_from_snapshot" :: held 11.523s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:33:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-eb9f12aa-80d6-4f93-b6d8-e229973294dc-c8d06dfc-e0f9-41f9-b675-bc904b305d6b" released by "_create_volume_from_snapshot" :: held 11.576s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:33:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.614s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:57 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-2739533e-e7a8-4aa2-b453-52711154dd61 tempest-GroupSnapshotsTest-830225659 None] Create group from source-snapshot-6f6bb2da-94f1-4bf1-aab1-95722790054e completed successfully. Jul 10 04:33:59 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cb52a55b-c48b-422d-8d80-9d10a6068a4b tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "cinder-quobyte-c8d06dfc-e0f9-41f9-b675-bc904b305d6b" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:33:59 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cb52a55b-c48b-422d-8d80-9d10a6068a4b tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-c8d06dfc-e0f9-41f9-b675-bc904b305d6b" acquired by "delete_volume" :: waited 0.033s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:33:59 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92e5965-938b-441c-91a6-80c7ccf90834]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:33:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cb52a55b-c48b-422d-8d80-9d10a6068a4b tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c8d06dfc-e0f9-41f9-b675-bc904b305d6b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:59 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c8d06dfc-e0f9-41f9-b675-bc904b305d6b Jul 10 04:33:59 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:00 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cb52a55b-c48b-422d-8d80-9d10a6068a4b tempest-GroupSnapshotsTest-830225659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c8d06dfc-e0f9-41f9-b675-bc904b305d6b" returned: 0 in 1.171s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cb52a55b-c48b-422d-8d80-9d10a6068a4b tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c8d06dfc-e0f9-41f9-b675-bc904b305d6b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:00 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c8d06dfc-e0f9-41f9-b675-bc904b305d6b Jul 10 04:34:00 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:01 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cb52a55b-c48b-422d-8d80-9d10a6068a4b tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c8d06dfc-e0f9-41f9-b675-bc904b305d6b" returned: 0 in 0.927s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cb52a55b-c48b-422d-8d80-9d10a6068a4b tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-c8d06dfc-e0f9-41f9-b675-bc904b305d6b" released by "delete_volume" :: held 2.181s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:34:01 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-cb52a55b-c48b-422d-8d80-9d10a6068a4b tempest-GroupSnapshotsTest-830225659 None] Created reservations ['84af2cfe-9728-406c-a936-3ff518e39d3c'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:34:02 devstack cinder-volume[87359]: WARNING cinder.quota [None req-cb52a55b-c48b-422d-8d80-9d10a6068a4b tempest-GroupSnapshotsTest-830225659 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-676999396 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-676999396, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:34:02 devstack cinder-volume[87359]: WARNING cinder.quota [None req-cb52a55b-c48b-422d-8d80-9d10a6068a4b tempest-GroupSnapshotsTest-830225659 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-676999396 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-676999396, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:34:02 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-cb52a55b-c48b-422d-8d80-9d10a6068a4b tempest-GroupSnapshotsTest-830225659 None] Created reservations ['0e488e7a-99ef-4dc4-913b-89c2acbf5fa6', '804688f8-d4c9-4653-a8b2-61771c354273', 'bc805f29-4206-411d-aad9-43fe551b8dac', 'cd0acbbc-be80-473d-8e90-3ff82c27afd4'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:34:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-cb52a55b-c48b-422d-8d80-9d10a6068a4b tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-cb52a55b-c48b-422d-8d80-9d10a6068a4b tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-cb52a55b-c48b-422d-8d80-9d10a6068a4b tempest-GroupSnapshotsTest-830225659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:34:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-cb52a55b-c48b-422d-8d80-9d10a6068a4b tempest-GroupSnapshotsTest-830225659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:34:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-cb52a55b-c48b-422d-8d80-9d10a6068a4b tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cb52a55b-c48b-422d-8d80-9d10a6068a4b tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:02 devstack sudo[88670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:34:02 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:03 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cb52a55b-c48b-422d-8d80-9d10a6068a4b tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.247s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:03 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-cb52a55b-c48b-422d-8d80-9d10a6068a4b tempest-GroupSnapshotsTest-830225659 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:34:03 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-cb52a55b-c48b-422d-8d80-9d10a6068a4b tempest-GroupSnapshotsTest-830225659 None] Delete group completed successfully. Jul 10 04:34:03 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-463ed750-819d-4bb9-9ece-080385713946 tempest-GroupSnapshotsTest-830225659 None] group_snapshot 6f6bb2da-94f1-4bf1-aab1-95722790054e: deleting Jul 10 04:34:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-463ed750-819d-4bb9-9ece-080385713946 tempest-GroupSnapshotsTest-830225659 None] group_snapshot 6f6bb2da-94f1-4bf1-aab1-95722790054e: deleting {{(pid=87359) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4401}} Jul 10 04:34:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-463ed750-819d-4bb9-9ece-080385713946 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "cinder-quobyte-e4c8baed-b3e6-4702-9f6f-0074a542d5ed" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:34:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-463ed750-819d-4bb9-9ece-080385713946 tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-e4c8baed-b3e6-4702-9f6f-0074a542d5ed" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:34:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-463ed750-819d-4bb9-9ece-080385713946 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "cinder-quobyte-eb9f12aa-80d6-4f93-b6d8-e229973294dc" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:34:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-463ed750-819d-4bb9-9ece-080385713946 tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-eb9f12aa-80d6-4f93-b6d8-e229973294dc" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:34:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-463ed750-819d-4bb9-9ece-080385713946 tempest-GroupSnapshotsTest-830225659 None] Deleting offline snapshot eb9f12aa-80d6-4f93-b6d8-e229973294dc of volume e4c8baed-b3e6-4702-9f6f-0074a542d5ed {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:34:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-463ed750-819d-4bb9-9ece-080385713946 tempest-GroupSnapshotsTest-830225659 None] snapshot_file for this snap is: volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:34:03 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d856d92-6ba9-4e25-afed-a1495e55eb76]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:34:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-463ed750-819d-4bb9-9ece-080385713946 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:04 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc Jul 10 04:34:04 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:05 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-463ed750-819d-4bb9-9ece-080385713946 tempest-GroupSnapshotsTest-830225659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc" returned: 0 in 1.904s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-463ed750-819d-4bb9-9ece-080385713946 tempest-GroupSnapshotsTest-830225659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:34:05 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3607db2-5c4c-4415-b096-e5744b2adb65]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:34:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-463ed750-819d-4bb9-9ece-080385713946 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:06 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed Jul 10 04:34:06 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:08 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-463ed750-819d-4bb9-9ece-080385713946 tempest-GroupSnapshotsTest-830225659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed" returned: 0 in 2.175s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-463ed750-819d-4bb9-9ece-080385713946 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:08 devstack sudo[88739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc Jul 10 04:34:08 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:09 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-463ed750-819d-4bb9-9ece-080385713946 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc" returned: 0 in 1.456s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-463ed750-819d-4bb9-9ece-080385713946 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:09 devstack sudo[88752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc Jul 10 04:34:09 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:10 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-463ed750-819d-4bb9-9ece-080385713946 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed.eb9f12aa-80d6-4f93-b6d8-e229973294dc" returned: 0 in 1.174s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-463ed750-819d-4bb9-9ece-080385713946 tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-eb9f12aa-80d6-4f93-b6d8-e229973294dc" released by "_delete_snapshot" :: held 6.938s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:34:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-463ed750-819d-4bb9-9ece-080385713946 tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-e4c8baed-b3e6-4702-9f6f-0074a542d5ed" released by "delete_snapshot" :: held 6.974s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:34:10 devstack cinder-volume[87359]: WARNING cinder.quota [None req-463ed750-819d-4bb9-9ece-080385713946 tempest-GroupSnapshotsTest-830225659 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-676999396 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-676999396, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:34:10 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-463ed750-819d-4bb9-9ece-080385713946 tempest-GroupSnapshotsTest-830225659 None] Created reservations ['b641788a-9c6a-4db4-afa5-824904ed1d5d', '715fd6f6-474b-46a4-b02e-610de6d8aef5', '117e1af4-0763-45fc-9f28-de966b938d47', '8593c762-37e4-4ab7-b15b-39d82197cf50'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:34:11 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-463ed750-819d-4bb9-9ece-080385713946 tempest-GroupSnapshotsTest-830225659 None] group_snapshot 6f6bb2da-94f1-4bf1-aab1-95722790054e: deleted successfully Jul 10 04:34:12 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2c3dfd7b-e006-459c-bdfa-6bb260e3423e tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "cinder-quobyte-e4c8baed-b3e6-4702-9f6f-0074a542d5ed" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:34:12 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2c3dfd7b-e006-459c-bdfa-6bb260e3423e tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-e4c8baed-b3e6-4702-9f6f-0074a542d5ed" acquired by "delete_volume" :: waited 0.032s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:34:12 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce4fe66-9fc2-4d4d-8c48-eadb73323c3e]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:34:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2c3dfd7b-e006-459c-bdfa-6bb260e3423e tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:12 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed Jul 10 04:34:12 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:13 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2c3dfd7b-e006-459c-bdfa-6bb260e3423e tempest-GroupSnapshotsTest-830225659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed" returned: 0 in 1.336s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2c3dfd7b-e006-459c-bdfa-6bb260e3423e tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:13 devstack sudo[88780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed Jul 10 04:34:13 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:14 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2c3dfd7b-e006-459c-bdfa-6bb260e3423e tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4c8baed-b3e6-4702-9f6f-0074a542d5ed" returned: 0 in 1.361s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2c3dfd7b-e006-459c-bdfa-6bb260e3423e tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-e4c8baed-b3e6-4702-9f6f-0074a542d5ed" released by "delete_volume" :: held 2.824s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:34:15 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-2c3dfd7b-e006-459c-bdfa-6bb260e3423e tempest-GroupSnapshotsTest-830225659 None] Created reservations ['bdb038c7-6c30-4382-9b15-02c134aef81c'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:34:15 devstack cinder-volume[87359]: WARNING cinder.db.api [None req-2c3dfd7b-e006-459c-bdfa-6bb260e3423e tempest-GroupSnapshotsTest-830225659 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-676999396'] Jul 10 04:34:15 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-2c3dfd7b-e006-459c-bdfa-6bb260e3423e tempest-GroupSnapshotsTest-830225659 None] Created reservations ['37398914-9471-497a-a789-c10e604c5fa5', 'abed4135-c399-4072-be4c-6d1892bd8489', '4f1d1876-c0fb-4802-bcc2-e9aea7edab8e', '6a630e4e-f6a0-4fd3-9031-5441fb687fea'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:34:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2c3dfd7b-e006-459c-bdfa-6bb260e3423e tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2c3dfd7b-e006-459c-bdfa-6bb260e3423e tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2c3dfd7b-e006-459c-bdfa-6bb260e3423e tempest-GroupSnapshotsTest-830225659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:34:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2c3dfd7b-e006-459c-bdfa-6bb260e3423e tempest-GroupSnapshotsTest-830225659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:34:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2c3dfd7b-e006-459c-bdfa-6bb260e3423e tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2c3dfd7b-e006-459c-bdfa-6bb260e3423e tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:15 devstack sudo[88789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:34:15 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:34:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:34:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:34:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:15 devstack sudo[88813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:34:15 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:17 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2c3dfd7b-e006-459c-bdfa-6bb260e3423e tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.593s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:17 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-2c3dfd7b-e006-459c-bdfa-6bb260e3423e tempest-GroupSnapshotsTest-830225659 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:34:17 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-2c3dfd7b-e006-459c-bdfa-6bb260e3423e tempest-GroupSnapshotsTest-830225659 None] Delete group completed successfully. Jul 10 04:34:17 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-de1b5851-8e61-4a12-912d-ee6cad49deb5 tempest-GroupSnapshotsTest-830225659 None] Group tempest-GroupSnapshotsTest-Group-2034929239: creating Jul 10 04:34:17 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-de1b5851-8e61-4a12-912d-ee6cad49deb5 tempest-GroupSnapshotsTest-830225659 None] Group tempest-GroupSnapshotsTest-Group-2034929239: created successfully Jul 10 04:34:17 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-de1b5851-8e61-4a12-912d-ee6cad49deb5 tempest-GroupSnapshotsTest-830225659 None] Create group completed successfully. Jul 10 04:34:17 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.679s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:17 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:34:17 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:34:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 8 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:34:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:34:17 devstack cinder-volume[87359]: WARNING py.warnings [req-4196bb83-192f-4faa-9c7b-a63122af38b2 req-57193861-a26b-4b95-8833-41209f3ee9ef tempest-TaggedAttachmentsTest-405705856 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 10 04:34:17 devstack cinder-volume[87359]: .first() Jul 10 04:34:17 devstack cinder-volume[87359]: Jul 10 04:34:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-4196bb83-192f-4faa-9c7b-a63122af38b2 req-57193861-a26b-4b95-8833-41209f3ee9ef tempest-TaggedAttachmentsTest-405705856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-4196bb83-192f-4faa-9c7b-a63122af38b2 req-57193861-a26b-4b95-8833-41209f3ee9ef tempest-TaggedAttachmentsTest-405705856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:17 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2cc889-4639-46d5-bd9c-c3e214757397]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:34:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-4196bb83-192f-4faa-9c7b-a63122af38b2 req-57193861-a26b-4b95-8833-41209f3ee9ef tempest-TaggedAttachmentsTest-405705856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9bfc0788-5766-4c95-ae8b-ab90538014ad {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:18 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9bfc0788-5766-4c95-ae8b-ab90538014ad Jul 10 04:34:18 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:19 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-4196bb83-192f-4faa-9c7b-a63122af38b2 req-57193861-a26b-4b95-8833-41209f3ee9ef tempest-TaggedAttachmentsTest-405705856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9bfc0788-5766-4c95-ae8b-ab90538014ad" returned: 0 in 1.531s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-4196bb83-192f-4faa-9c7b-a63122af38b2 req-57193861-a26b-4b95-8833-41209f3ee9ef tempest-TaggedAttachmentsTest-405705856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.568s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-4196bb83-192f-4faa-9c7b-a63122af38b2 req-57193861-a26b-4b95-8833-41209f3ee9ef tempest-TaggedAttachmentsTest-405705856 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31', 'name': 'volume-9bfc0788-5766-4c95-ae8b-ab90538014ad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7dd77e08-46ed-45d9-9f01-b275e1370c5f', 'enforce_multipath': True} {{(pid=87359) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4975}} Jul 10 04:34:19 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-4196bb83-192f-4faa-9c7b-a63122af38b2 req-57193861-a26b-4b95-8833-41209f3ee9ef tempest-TaggedAttachmentsTest-405705856 None] attachment_update completed successfully. Jul 10 04:34:19 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:34:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Flow 'volume_create_manager' (4573a427-f77b-461a-80e2-51fb8e4ec955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:34:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (484d6bfd-b42c-409c-bba3-0eb9ba835e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (484d6bfd-b42c-409c-bba3-0eb9ba835e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1794654986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2469ba5a-3268-4105-9202-afa7e5f0000e,host='devstack@QuobyteHD#QuobyteHD',id=8b4a0ebc-6eb2-403b-85dd-feec8442ac00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5783e30b805c46b88521741eaa5c6c7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:34:20Z,use_quota=True,user_id='db465a938a7f4101ae320ff16479b382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(064aade1-0c4b-4130-877e-a9224d27be90),volume_type_id=064aade1-0c4b-4130-877e-a9224d27be90)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2077da58-4336-403b-9603-f22b0ba13a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2077da58-4336-403b-9603-f22b0ba13a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39689fd-bb84-4a5a-b7ef-476656f05ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39689fd-bb84-4a5a-b7ef-476656f05ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b4a0ebc-6eb2-403b-85dd-feec8442ac00', 'volume_name': 'volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30a1ba5-ff1a-4e70-ab21-70e2ff1c4e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30a1ba5-ff1a-4e70-ab21-70e2ff1c4e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d605980-40b8-4aa9-86b6-387edf68367e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:20 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Volume 8b4a0ebc-6eb2-403b-85dd-feec8442ac00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00', 'volume_size': 1} Jul 10 04:34:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2469ba5a-3268-4105-9202-afa7e5f0000e,created_at=2026-07-10T02:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1794654986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2469ba5a-3268-4105-9202-afa7e5f0000e,host='devstack@QuobyteHD#QuobyteHD',id=8b4a0ebc-6eb2-403b-85dd-feec8442ac00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5783e30b805c46b88521741eaa5c6c7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:34:20Z,use_quota=True,user_id='db465a938a7f4101ae320ff16479b382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(064aade1-0c4b-4130-877e-a9224d27be90),volume_type_id=064aade1-0c4b-4130-877e-a9224d27be90)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:34:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Creating volume 8b4a0ebc-6eb2-403b-85dd-feec8442ac00 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:34:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:34:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:34:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:34:20 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:34:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:20 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00 1073741824 Jul 10 04:34:20 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:21 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:34:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Flow 'volume_create_manager' (bc4ac716-b7f2-4ded-a069-cd46f5af3e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:34:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f918683-20b8-49c7-813f-ad3b276df829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f918683-20b8-49c7-813f-ad3b276df829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1176824828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=017e3022-02bd-4b52-8068-0e4e8b31985c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e355bf8516946d1a799dfd717d1e4db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:34:21Z,use_quota=True,user_id='86f5b89594f44779ab87b01e675a606f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471ae9d2-ddaf-4f9b-b17b-796c78fa7125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471ae9d2-ddaf-4f9b-b17b-796c78fa7125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b63712-e401-4952-ad26-fc30e8184fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b63712-e401-4952-ad26-fc30e8184fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '017e3022-02bd-4b52-8068-0e4e8b31985c', 'volume_name': 'volume-017e3022-02bd-4b52-8068-0e4e8b31985c', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdea1aa4-5914-4005-8b8a-04fba67d7f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdea1aa4-5914-4005-8b8a-04fba67d7f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c756bb2-23f7-4cbb-843a-b3a77ff3a513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:21 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Volume 017e3022-02bd-4b52-8068-0e4e8b31985c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-017e3022-02bd-4b52-8068-0e4e8b31985c', 'volume_size': 1} Jul 10 04:34:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:21 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00 1073741824" returned: 0 in 1.788s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:21 devstack sudo[89249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00 Jul 10 04:34:21 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:22 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00" returned: 0 in 0.797s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] <== create_volume: return (2639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:34:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.642s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.093s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1176824828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=017e3022-02bd-4b52-8068-0e4e8b31985c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e355bf8516946d1a799dfd717d1e4db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:34:21Z,use_quota=True,user_id='86f5b89594f44779ab87b01e675a606f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:34:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Creating volume 017e3022-02bd-4b52-8068-0e4e8b31985c {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:34:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:34:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:34:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:34:22 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:34:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-017e3022-02bd-4b52-8068-0e4e8b31985c 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:22 devstack sudo[89257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-017e3022-02bd-4b52-8068-0e4e8b31985c 1073741824 Jul 10 04:34:22 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d605980-40b8-4aa9-86b6-387edf68367e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a0eb85-6930-4ca2-a399-0ceeaf52251a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:22 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Volume volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00 (8b4a0ebc-6eb2-403b-85dd-feec8442ac00): created successfully Jul 10 04:34:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a0eb85-6930-4ca2-a399-0ceeaf52251a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Flow 'volume_create_manager' (4573a427-f77b-461a-80e2-51fb8e4ec955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:34:22 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-4f667d42-9d9f-4bbc-b411-3545b237dba9 tempest-GroupSnapshotsTest-830225659 None] Created volume successfully. Jul 10 04:34:24 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-017e3022-02bd-4b52-8068-0e4e8b31985c 1073741824" returned: 0 in 1.435s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-017e3022-02bd-4b52-8068-0e4e8b31985c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:24 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-017e3022-02bd-4b52-8068-0e4e8b31985c Jul 10 04:34:24 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:24 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:34:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Flow 'volume_create_manager' (18c211f2-a75e-4499-9100-53a1aac63620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:34:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89ef218-36f5-4603-9b73-e269fb3063e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89ef218-36f5-4603-9b73-e269fb3063e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1933732085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2469ba5a-3268-4105-9202-afa7e5f0000e,host='devstack@QuobyteHD#QuobyteHD',id=5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5783e30b805c46b88521741eaa5c6c7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:34:25Z,use_quota=True,user_id='db465a938a7f4101ae320ff16479b382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(064aade1-0c4b-4130-877e-a9224d27be90),volume_type_id=064aade1-0c4b-4130-877e-a9224d27be90)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2ca0dd-03aa-40d8-9472-0b29dd01b9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2ca0dd-03aa-40d8-9472-0b29dd01b9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e03a2144-31bc-4735-b823-d4af04568d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e03a2144-31bc-4735-b823-d4af04568d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a', 'volume_name': 'volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99aece5-be97-4e9b-ac3b-c01db0623d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99aece5-be97-4e9b-ac3b-c01db0623d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2168685e-4207-4f04-922e-adedaafaeed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:24 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Volume 5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a', 'volume_size': 1} Jul 10 04:34:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:25 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-017e3022-02bd-4b52-8068-0e4e8b31985c" returned: 0 in 1.030s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] <== create_volume: return (2531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:34:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.535s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.367s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2469ba5a-3268-4105-9202-afa7e5f0000e,created_at=2026-07-10T02:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1933732085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2469ba5a-3268-4105-9202-afa7e5f0000e,host='devstack@QuobyteHD#QuobyteHD',id=5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5783e30b805c46b88521741eaa5c6c7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:34:25Z,use_quota=True,user_id='db465a938a7f4101ae320ff16479b382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(064aade1-0c4b-4130-877e-a9224d27be90),volume_type_id=064aade1-0c4b-4130-877e-a9224d27be90)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:34:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Creating volume 5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:34:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:34:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:34:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:34:25 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:34:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c756bb2-23f7-4cbb-843a-b3a77ff3a513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-017e3022-02bd-4b52-8068-0e4e8b31985c', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25c5d72-9eb0-4b97-a0ad-b7d00c6ea295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:25 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Volume volume-017e3022-02bd-4b52-8068-0e4e8b31985c (017e3022-02bd-4b52-8068-0e4e8b31985c): created successfully Jul 10 04:34:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25c5d72-9eb0-4b97-a0ad-b7d00c6ea295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Flow 'volume_create_manager' (bc4ac716-b7f2-4ded-a069-cd46f5af3e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:34:25 devstack sudo[89268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a 1073741824 Jul 10 04:34:25 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:25 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d3fe1567-a58e-4592-8cb2-a165913f2a72 tempest-ServerRescueNegativeTestJSON-519302181 None] Created volume successfully. Jul 10 04:34:26 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a 1073741824" returned: 0 in 1.479s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:26 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a Jul 10 04:34:26 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:27 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a" returned: 0 in 0.903s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] <== create_volume: return (2437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:34:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.442s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2168685e-4207-4f04-922e-adedaafaeed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2bb7e7a-a933-4e4b-bdc0-9c7a61393707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:27 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Volume volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a (5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a): created successfully Jul 10 04:34:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2bb7e7a-a933-4e4b-bdc0-9c7a61393707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Flow 'volume_create_manager' (18c211f2-a75e-4499-9100-53a1aac63620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:34:27 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-927ec75f-b507-4b6c-90b0-8fbf17f858a0 tempest-GroupSnapshotsTest-830225659 None] Created volume successfully. Jul 10 04:34:28 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-5c3bfcc4-0886-4fcb-a9d2-482b8a04b1a6 req-65129fb1-4108-455a-9df1-fed52d63d68e tempest-TaggedAttachmentsTest-405705856 None] Terminate volume connection completed successfully. Jul 10 04:34:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-5c3bfcc4-0886-4fcb-a9d2-482b8a04b1a6 req-65129fb1-4108-455a-9df1-fed52d63d68e tempest-TaggedAttachmentsTest-405705856 None] Deleting attachment 7dd77e08-46ed-45d9-9f01-b275e1370c5f. {{(pid=87359) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5106}} Jul 10 04:34:28 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-72ec2e64-46bb-48ab-99ca-878fe333fbe6 tempest-GroupSnapshotsTest-830225659 None] Update group completed successfully. Jul 10 04:34:30 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-14fc2199-079e-4115-9684-e3bb5bc6e923 tempest-GroupSnapshotsTest-830225659 None] Update group completed successfully. Jul 10 04:34:31 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-19e2bbda-d5a0-4293-8db5-7321452ee62f tempest-GroupSnapshotsTest-830225659 None] Update group completed successfully. Jul 10 04:34:32 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-fd04bc4a-a02a-49dc-b37b-e50cb0b4f47c tempest-GroupSnapshotsTest-830225659 None] Update group completed successfully. Jul 10 04:34:34 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] GroupSnapshot 4247af14-e082-4aa4-80c0-1d7e805f63dd: creating. Jul 10 04:34:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] Group snapshot 4247af14-e082-4aa4-80c0-1d7e805f63dd: creating. {{(pid=87359) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4226}} Jul 10 04:34:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] Creating offline snapshot 8e3f4197-fff6-40ac-906b-615bf8968b5d of volume 5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:34:34 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c1510b-2444-4faf-a943-6d80ee83e4a6]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:34:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:34 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a Jul 10 04:34:34 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:35 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a" returned: 0 in 1.168s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.8e3f4197-fff6-40ac-906b-615bf8968b5d 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:35 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.8e3f4197-fff6-40ac-906b-615bf8968b5d 1G Jul 10 04:34:35 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:36 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.8e3f4197-fff6-40ac-906b-615bf8968b5d 1G" returned: 0 in 1.094s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.8e3f4197-fff6-40ac-906b-615bf8968b5d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:36 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.8e3f4197-fff6-40ac-906b-615bf8968b5d Jul 10 04:34:36 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:38 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.8e3f4197-fff6-40ac-906b-615bf8968b5d" returned: 0 in 1.544s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:38 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.8e3f4197-fff6-40ac-906b-615bf8968b5d is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:34:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.8e3f4197-fff6-40ac-906b-615bf8968b5d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:38 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.8e3f4197-fff6-40ac-906b-615bf8968b5d Jul 10 04:34:38 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:39 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.8e3f4197-fff6-40ac-906b-615bf8968b5d" returned: 0 in 1.174s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:39 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.info Jul 10 04:34:39 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:40 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.info" returned: 0 in 1.271s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:40 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:34:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:41 devstack sudo[89522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.info Jul 10 04:34:41 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:42 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.info" returned: 0 in 1.130s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.712s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] Creating offline snapshot aaa999b5-fce2-4097-adac-6f2f449c36b3 of volume 8b4a0ebc-6eb2-403b-85dd-feec8442ac00 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:34:42 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83e1c8d-5d48-4eca-8c11-dfa93514de1f]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:34:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:42 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:34:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Flow 'volume_create_manager' (d8535e71-875a-4fd2-ae28-93d9074377f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:34:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a09b3b9-8c74-44e3-a67f-21942b3aac92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:42 devstack sudo[89526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00 Jul 10 04:34:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a09b3b9-8c74-44e3-a67f-21942b3aac92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-273856215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2ee19c-39ea-4797-b5e7-e47b46225737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a3238c6f984dec92ed992f78f93837',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:34:42Z,use_quota=True,user_id='cd9a72c0184e484c8da0ee423990c347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:42 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e86039-51e8-49b4-beee-2cfb0fc3fac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e86039-51e8-49b4-beee-2cfb0fc3fac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc06a10b-021f-4716-824a-a89498f3fb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc06a10b-021f-4716-824a-a89498f3fb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb2ee19c-39ea-4797-b5e7-e47b46225737', 'volume_name': 'volume-fb2ee19c-39ea-4797-b5e7-e47b46225737', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7263f617-bb95-4498-990e-fbff0b528ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7263f617-bb95-4498-990e-fbff0b528ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3437e7d7-1d15-4a8c-a569-a07fc211ac27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:42 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Volume fb2ee19c-39ea-4797-b5e7-e47b46225737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb2ee19c-39ea-4797-b5e7-e47b46225737', 'volume_size': 1} Jul 10 04:34:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:43 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00" returned: 0 in 1.405s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.aaa999b5-fce2-4097-adac-6f2f449c36b3 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:43 devstack sudo[89534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.aaa999b5-fce2-4097-adac-6f2f449c36b3 1G Jul 10 04:34:43 devstack sudo[89534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:44 devstack sudo[89534]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.aaa999b5-fce2-4097-adac-6f2f449c36b3 1G" returned: 0 in 1.025s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.aaa999b5-fce2-4097-adac-6f2f449c36b3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:44 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.aaa999b5-fce2-4097-adac-6f2f449c36b3 Jul 10 04:34:44 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:45 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.aaa999b5-fce2-4097-adac-6f2f449c36b3" returned: 0 in 0.946s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:45 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.aaa999b5-fce2-4097-adac-6f2f449c36b3 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:34:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.aaa999b5-fce2-4097-adac-6f2f449c36b3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:45 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.aaa999b5-fce2-4097-adac-6f2f449c36b3 Jul 10 04:34:45 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:46 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.aaa999b5-fce2-4097-adac-6f2f449c36b3" returned: 0 in 0.772s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:46 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.info Jul 10 04:34:46 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-68040f18-0de8-4ebd-9a44-eb68ef8b3cc2 tempest-ServerRescueNegativeTestJSON-519302181 None] Acquiring lock "cinder-017e3022-02bd-4b52-8068-0e4e8b31985c-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:34:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-68040f18-0de8-4ebd-9a44-eb68ef8b3cc2 tempest-ServerRescueNegativeTestJSON-519302181 None] Lock "cinder-017e3022-02bd-4b52-8068-0e4e8b31985c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:34:47 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.info" returned: 0 in 0.782s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:47 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:34:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-68040f18-0de8-4ebd-9a44-eb68ef8b3cc2 tempest-ServerRescueNegativeTestJSON-519302181 None] Acquiring lock "cinder-quobyte-017e3022-02bd-4b52-8068-0e4e8b31985c" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:34:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-68040f18-0de8-4ebd-9a44-eb68ef8b3cc2 tempest-ServerRescueNegativeTestJSON-519302181 None] Lock "cinder-quobyte-017e3022-02bd-4b52-8068-0e4e8b31985c" acquired by "delete_volume" :: waited 0.022s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:34:47 devstack sudo[89581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.info Jul 10 04:34:47 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:47 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[43141960-6097-4bb8-99ff-09e3683fe04a]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:34:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-68040f18-0de8-4ebd-9a44-eb68ef8b3cc2 tempest-ServerRescueNegativeTestJSON-519302181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-017e3022-02bd-4b52-8068-0e4e8b31985c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:47 devstack sudo[89583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-017e3022-02bd-4b52-8068-0e4e8b31985c Jul 10 04:34:47 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:48 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:48 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-68040f18-0de8-4ebd-9a44-eb68ef8b3cc2 tempest-ServerRescueNegativeTestJSON-519302181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-017e3022-02bd-4b52-8068-0e4e8b31985c" returned: 0 in 0.984s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-68040f18-0de8-4ebd-9a44-eb68ef8b3cc2 tempest-ServerRescueNegativeTestJSON-519302181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-017e3022-02bd-4b52-8068-0e4e8b31985c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.info" returned: 0 in 1.104s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:48 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-017e3022-02bd-4b52-8068-0e4e8b31985c Jul 10 04:34:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.238s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:48 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.707s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-273856215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2ee19c-39ea-4797-b5e7-e47b46225737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a3238c6f984dec92ed992f78f93837',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:34:42Z,use_quota=True,user_id='cd9a72c0184e484c8da0ee423990c347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:34:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Creating volume fb2ee19c-39ea-4797-b5e7-e47b46225737 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:34:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:34:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:34:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:34:48 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:34:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fb2ee19c-39ea-4797-b5e7-e47b46225737 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:48 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fb2ee19c-39ea-4797-b5e7-e47b46225737 1073741824 Jul 10 04:34:48 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:48 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-7c0a67e8-6502-436c-a2b5-f28b9c09afa2 tempest-GroupSnapshotsTest-830225659 None] group_snapshot 4247af14-e082-4aa4-80c0-1d7e805f63dd: created successfully Jul 10 04:34:49 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-68040f18-0de8-4ebd-9a44-eb68ef8b3cc2 tempest-ServerRescueNegativeTestJSON-519302181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-017e3022-02bd-4b52-8068-0e4e8b31985c" returned: 0 in 1.199s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:49 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-68040f18-0de8-4ebd-9a44-eb68ef8b3cc2 tempest-ServerRescueNegativeTestJSON-519302181 None] Lock "cinder-quobyte-017e3022-02bd-4b52-8068-0e4e8b31985c" released by "delete_volume" :: held 2.254s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:34:49 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-68040f18-0de8-4ebd-9a44-eb68ef8b3cc2 tempest-ServerRescueNegativeTestJSON-519302181 None] Created reservations ['eb5ea946-58fd-45fa-9269-2ca96ecc6925', '835553ad-d705-433b-a81e-b1e34ab71238', 'ea6a121a-81ea-4a4c-bc15-439c3783f25a', '67580b0d-c7c5-4b8c-80e5-158e255e7254'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:34:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-68040f18-0de8-4ebd-9a44-eb68ef8b3cc2 tempest-ServerRescueNegativeTestJSON-519302181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-68040f18-0de8-4ebd-9a44-eb68ef8b3cc2 tempest-ServerRescueNegativeTestJSON-519302181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-68040f18-0de8-4ebd-9a44-eb68ef8b3cc2 tempest-ServerRescueNegativeTestJSON-519302181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:34:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-68040f18-0de8-4ebd-9a44-eb68ef8b3cc2 tempest-ServerRescueNegativeTestJSON-519302181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:34:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-68040f18-0de8-4ebd-9a44-eb68ef8b3cc2 tempest-ServerRescueNegativeTestJSON-519302181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-68040f18-0de8-4ebd-9a44-eb68ef8b3cc2 tempest-ServerRescueNegativeTestJSON-519302181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:49 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:34:49 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:50 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] group_snapshot 4247af14-e082-4aa4-80c0-1d7e805f63dd: deleting Jul 10 04:34:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] group_snapshot 4247af14-e082-4aa4-80c0-1d7e805f63dd: deleting {{(pid=87359) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4401}} Jul 10 04:34:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "cinder-quobyte-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:34:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:34:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "cinder-quobyte-8e3f4197-fff6-40ac-906b-615bf8968b5d" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:34:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-8e3f4197-fff6-40ac-906b-615bf8968b5d" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:34:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Deleting offline snapshot 8e3f4197-fff6-40ac-906b-615bf8968b5d of volume 5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:34:50 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] snapshot_file for this snap is: volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.8e3f4197-fff6-40ac-906b-615bf8968b5d {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:34:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fb2ee19c-39ea-4797-b5e7-e47b46225737 1073741824" returned: 0 in 1.842s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:50 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[6560464b-867e-402d-a85d-db720d330253]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:34:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.8e3f4197-fff6-40ac-906b-615bf8968b5d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fb2ee19c-39ea-4797-b5e7-e47b46225737 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:50 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fb2ee19c-39ea-4797-b5e7-e47b46225737 Jul 10 04:34:50 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:50 devstack sudo[89603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.8e3f4197-fff6-40ac-906b-615bf8968b5d Jul 10 04:34:50 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:51 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-68040f18-0de8-4ebd-9a44-eb68ef8b3cc2 tempest-ServerRescueNegativeTestJSON-519302181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.415s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:51 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-68040f18-0de8-4ebd-9a44-eb68ef8b3cc2 tempest-ServerRescueNegativeTestJSON-519302181 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:34:51 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-68040f18-0de8-4ebd-9a44-eb68ef8b3cc2 tempest-ServerRescueNegativeTestJSON-519302181 None] Deleted volume successfully. Jul 10 04:34:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-68040f18-0de8-4ebd-9a44-eb68ef8b3cc2 tempest-ServerRescueNegativeTestJSON-519302181 None] Lock "cinder-017e3022-02bd-4b52-8068-0e4e8b31985c-delete_volume" released by "delete_volume" :: held 4.144s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:34:51 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fb2ee19c-39ea-4797-b5e7-e47b46225737" returned: 0 in 1.476s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:51 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] <== create_volume: return (3457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:34:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.466s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:51 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3437e7d7-1d15-4a8c-a569-a07fc211ac27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2ee19c-39ea-4797-b5e7-e47b46225737', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:51 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8073102a-bdd8-4ff2-b85e-902d5eb63dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:51 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Volume volume-fb2ee19c-39ea-4797-b5e7-e47b46225737 (fb2ee19c-39ea-4797-b5e7-e47b46225737): created successfully Jul 10 04:34:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8073102a-bdd8-4ff2-b85e-902d5eb63dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Flow 'volume_create_manager' (d8535e71-875a-4fd2-ae28-93d9074377f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:34:52 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-7aafe931-6fed-4701-89fd-9cf1082d37e7 tempest-DeleteServersTestJSON-1430660026 None] Created volume successfully. Jul 10 04:34:52 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.8e3f4197-fff6-40ac-906b-615bf8968b5d" returned: 0 in 2.333s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:52 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:34:52 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb4a4d5-4485-4251-aa2c-b1a0e58ebebe]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:34:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:53 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a Jul 10 04:34:53 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-412b160a-9616-4361-94f5-c10d672d8090 tempest-TaggedAttachmentsTest-405705856 None] Acquiring lock "cinder-9bfc0788-5766-4c95-ae8b-ab90538014ad-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:34:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-412b160a-9616-4361-94f5-c10d672d8090 tempest-TaggedAttachmentsTest-405705856 None] Lock "cinder-9bfc0788-5766-4c95-ae8b-ab90538014ad-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:34:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-412b160a-9616-4361-94f5-c10d672d8090 tempest-TaggedAttachmentsTest-405705856 None] Acquiring lock "cinder-quobyte-9bfc0788-5766-4c95-ae8b-ab90538014ad" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:34:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-412b160a-9616-4361-94f5-c10d672d8090 tempest-TaggedAttachmentsTest-405705856 None] Lock "cinder-quobyte-9bfc0788-5766-4c95-ae8b-ab90538014ad" acquired by "delete_volume" :: waited 0.032s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:34:53 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[a120d7f2-bda4-4c15-bc6d-5b0591d86f08]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:34:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-412b160a-9616-4361-94f5-c10d672d8090 tempest-TaggedAttachmentsTest-405705856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9bfc0788-5766-4c95-ae8b-ab90538014ad {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:54 devstack sudo[89706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9bfc0788-5766-4c95-ae8b-ab90538014ad Jul 10 04:34:54 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:54 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a" returned: 0 in 1.597s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.8e3f4197-fff6-40ac-906b-615bf8968b5d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:54 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.8e3f4197-fff6-40ac-906b-615bf8968b5d Jul 10 04:34:54 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:55 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-412b160a-9616-4361-94f5-c10d672d8090 tempest-TaggedAttachmentsTest-405705856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9bfc0788-5766-4c95-ae8b-ab90538014ad" returned: 0 in 1.488s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-412b160a-9616-4361-94f5-c10d672d8090 tempest-TaggedAttachmentsTest-405705856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9bfc0788-5766-4c95-ae8b-ab90538014ad {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:55 devstack sudo[89729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9bfc0788-5766-4c95-ae8b-ab90538014ad Jul 10 04:34:55 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:55 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.8e3f4197-fff6-40ac-906b-615bf8968b5d" returned: 0 in 1.335s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.8e3f4197-fff6-40ac-906b-615bf8968b5d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:55 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.8e3f4197-fff6-40ac-906b-615bf8968b5d Jul 10 04:34:55 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-c19710ae-d5a7-4eb4-a787-b48e2db58bc0 req-88e99e6d-824c-424f-9923-72d5a3961259 tempest-DeleteServersTestJSON-1430660026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-c19710ae-d5a7-4eb4-a787-b48e2db58bc0 req-88e99e6d-824c-424f-9923-72d5a3961259 tempest-DeleteServersTestJSON-1430660026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:56 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[1791cc95-b3e5-423e-a3d6-2a6c3c684997]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:34:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-c19710ae-d5a7-4eb4-a787-b48e2db58bc0 req-88e99e6d-824c-424f-9923-72d5a3961259 tempest-DeleteServersTestJSON-1430660026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fb2ee19c-39ea-4797-b5e7-e47b46225737 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:56 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-412b160a-9616-4361-94f5-c10d672d8090 tempest-TaggedAttachmentsTest-405705856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9bfc0788-5766-4c95-ae8b-ab90538014ad" returned: 0 in 0.802s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-412b160a-9616-4361-94f5-c10d672d8090 tempest-TaggedAttachmentsTest-405705856 None] Lock "cinder-quobyte-9bfc0788-5766-4c95-ae8b-ab90538014ad" released by "delete_volume" :: held 2.423s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:34:56 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=53,cinder:SELECT=66,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:34:56 devstack sudo[89744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fb2ee19c-39ea-4797-b5e7-e47b46225737 Jul 10 04:34:56 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:56 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-412b160a-9616-4361-94f5-c10d672d8090 tempest-TaggedAttachmentsTest-405705856 None] Created reservations ['e2b40c46-a898-4f99-a023-903ba38f8f1a', '548cfb7c-5a49-4c4b-9846-25e94d778775', 'd4f4c127-c687-4f94-a976-1a9695deb97e', 'd4cc92ae-f960-48ac-ab4a-514b93ff772f'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:34:56 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=67,cinder:SELECT=73,cinder:INSERT=15,cinder:DELETE=3 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:34:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-412b160a-9616-4361-94f5-c10d672d8090 tempest-TaggedAttachmentsTest-405705856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-412b160a-9616-4361-94f5-c10d672d8090 tempest-TaggedAttachmentsTest-405705856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-412b160a-9616-4361-94f5-c10d672d8090 tempest-TaggedAttachmentsTest-405705856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:34:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-412b160a-9616-4361-94f5-c10d672d8090 tempest-TaggedAttachmentsTest-405705856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:34:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-412b160a-9616-4361-94f5-c10d672d8090 tempest-TaggedAttachmentsTest-405705856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-412b160a-9616-4361-94f5-c10d672d8090 tempest-TaggedAttachmentsTest-405705856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:56 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:34:56 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:56 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a.8e3f4197-fff6-40ac-906b-615bf8968b5d" returned: 0 in 1.201s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-8e3f4197-fff6-40ac-906b-615bf8968b5d" released by "_delete_snapshot" :: held 6.763s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:34:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a" released by "delete_snapshot" :: held 6.803s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:34:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "cinder-quobyte-8b4a0ebc-6eb2-403b-85dd-feec8442ac00" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:34:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-8b4a0ebc-6eb2-403b-85dd-feec8442ac00" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:34:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "cinder-quobyte-aaa999b5-fce2-4097-adac-6f2f449c36b3" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:34:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-aaa999b5-fce2-4097-adac-6f2f449c36b3" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:34:57 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Deleting offline snapshot aaa999b5-fce2-4097-adac-6f2f449c36b3 of volume 8b4a0ebc-6eb2-403b-85dd-feec8442ac00 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:34:57 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] snapshot_file for this snap is: volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.aaa999b5-fce2-4097-adac-6f2f449c36b3 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:34:57 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[881eccce-d3ef-4260-9df7-73378ce7e180]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:34:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.aaa999b5-fce2-4097-adac-6f2f449c36b3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:57 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.aaa999b5-fce2-4097-adac-6f2f449c36b3 Jul 10 04:34:57 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:57 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-412b160a-9616-4361-94f5-c10d672d8090 tempest-TaggedAttachmentsTest-405705856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.961s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:57 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-412b160a-9616-4361-94f5-c10d672d8090 tempest-TaggedAttachmentsTest-405705856 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:34:57 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-412b160a-9616-4361-94f5-c10d672d8090 tempest-TaggedAttachmentsTest-405705856 None] Deleted volume successfully. Jul 10 04:34:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-412b160a-9616-4361-94f5-c10d672d8090 tempest-TaggedAttachmentsTest-405705856 None] Lock "cinder-9bfc0788-5766-4c95-ae8b-ab90538014ad-delete_volume" released by "delete_volume" :: held 3.757s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:34:57 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-c19710ae-d5a7-4eb4-a787-b48e2db58bc0 req-88e99e6d-824c-424f-9923-72d5a3961259 tempest-DeleteServersTestJSON-1430660026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fb2ee19c-39ea-4797-b5e7-e47b46225737" returned: 0 in 1.442s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-c19710ae-d5a7-4eb4-a787-b48e2db58bc0 req-88e99e6d-824c-424f-9923-72d5a3961259 tempest-DeleteServersTestJSON-1430660026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.474s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:57 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-c19710ae-d5a7-4eb4-a787-b48e2db58bc0 req-88e99e6d-824c-424f-9923-72d5a3961259 tempest-DeleteServersTestJSON-1430660026 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31', 'name': 'volume-fb2ee19c-39ea-4797-b5e7-e47b46225737', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb45b693-54e6-4c3c-a852-5c2f3fd149c9', 'enforce_multipath': True} {{(pid=87359) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4975}} Jul 10 04:34:57 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-c19710ae-d5a7-4eb4-a787-b48e2db58bc0 req-88e99e6d-824c-424f-9923-72d5a3961259 tempest-DeleteServersTestJSON-1430660026 None] attachment_update completed successfully. Jul 10 04:34:58 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.aaa999b5-fce2-4097-adac-6f2f449c36b3" returned: 0 in 0.971s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:34:58 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa21011-271a-4e5c-9264-cdf485ef3914]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:34:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:58 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00 Jul 10 04:34:58 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:59 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00" returned: 0 in 1.027s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.aaa999b5-fce2-4097-adac-6f2f449c36b3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:59 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.aaa999b5-fce2-4097-adac-6f2f449c36b3 Jul 10 04:34:59 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:00 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.aaa999b5-fce2-4097-adac-6f2f449c36b3" returned: 0 in 1.231s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.aaa999b5-fce2-4097-adac-6f2f449c36b3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:00 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.aaa999b5-fce2-4097-adac-6f2f449c36b3 Jul 10 04:35:00 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:01 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00.aaa999b5-fce2-4097-adac-6f2f449c36b3" returned: 0 in 1.179s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-aaa999b5-fce2-4097-adac-6f2f449c36b3" released by "_delete_snapshot" :: held 4.578s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:35:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-8b4a0ebc-6eb2-403b-85dd-feec8442ac00" released by "delete_snapshot" :: held 4.619s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:35:01 devstack cinder-volume[87359]: WARNING cinder.quota [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-715368382 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-715368382, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:35:01 devstack cinder-volume[87359]: WARNING cinder.quota [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-715368382 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-715368382, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:35:01 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Created reservations ['f1694a61-ea2a-47f8-b937-b6c610241d34', 'b66a824a-42e7-4504-8203-c6f76c7d0ffd', 'cead4a86-2ee3-4d5f-af02-bab8d5aabd95', '6d1abb39-9791-4837-b920-f9b70cea6940'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:35:01 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] Created reservations ['140e609b-a8c7-43b9-a36f-39beb17b8ff6', '66e30b51-b2dc-41e4-b7da-dca27a71e65f', '87d6fa49-d1ab-40d2-8cc6-1200a03fbf12', '6ca0ce72-1f9e-4a52-92f9-02c48664f6ed'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:35:01 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-b7763078-a677-4232-899a-d465f6b3bbe0 tempest-GroupSnapshotsTest-830225659 None] group_snapshot 4247af14-e082-4aa4-80c0-1d7e805f63dd: deleted successfully Jul 10 04:35:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "cinder-quobyte-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:35:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a" acquired by "delete_volume" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:35:03 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[8894022b-8ee2-4897-afca-22f4a29039a8]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:35:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:03 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a Jul 10 04:35:03 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:04 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a" returned: 0 in 0.893s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:04 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a Jul 10 04:35:04 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:05 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a" returned: 0 in 0.869s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-5e24eb66-6e6c-41a8-952b-e2c9bf1e3a0a" released by "delete_volume" :: held 1.829s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:35:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "cinder-quobyte-8b4a0ebc-6eb2-403b-85dd-feec8442ac00" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:35:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-8b4a0ebc-6eb2-403b-85dd-feec8442ac00" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:35:05 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acb0c21-140e-4efb-933c-61952b715954]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:35:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:05 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00 Jul 10 04:35:05 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:06 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00" returned: 0 in 1.127s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:06 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00 Jul 10 04:35:06 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:07 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b4a0ebc-6eb2-403b-85dd-feec8442ac00" returned: 0 in 0.856s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:07 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-8b4a0ebc-6eb2-403b-85dd-feec8442ac00" released by "delete_volume" :: held 2.080s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:35:07 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] Created reservations ['6d3147f0-cef1-4d35-83cf-19c848872be6'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:35:07 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-1bd15eb3-1487-4c7d-aeea-d2327a6bc32d req-102c285b-a661-4515-82fa-2d2d6943355c tempest-DeleteServersTestJSON-1430660026 None] Terminate volume connection completed successfully. Jul 10 04:35:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-1bd15eb3-1487-4c7d-aeea-d2327a6bc32d req-102c285b-a661-4515-82fa-2d2d6943355c tempest-DeleteServersTestJSON-1430660026 None] Deleting attachment eb45b693-54e6-4c3c-a852-5c2f3fd149c9. {{(pid=87359) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5106}} Jul 10 04:35:07 devstack cinder-volume[87359]: WARNING cinder.quota [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-715368382 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-715368382, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:35:07 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] Created reservations ['51392e24-ba5e-4af6-b2ef-8dab1bc9dfba', 'c1788faf-37b3-47c7-843e-6e8b7709f7f1', '68f280f6-9acc-4512-a642-cf1c20626e23', 'fdaf7da2-ac96-4f1d-b3bc-7833604b43e5'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:35:07 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] Created reservations ['b2c1585f-7671-465a-a97a-e7a7c9b57a25', '531ce5c4-f92a-4aec-b157-a7b1e35ef08b', 'a5398649-7877-4e25-9f4f-fafef5594209', '7b5f5972-9e5d-4da9-8472-6ba6e3420b4e'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:35:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:35:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:35:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:35:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:35:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:35:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:07 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:35:07 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:08 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.906s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:08 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:35:08 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-dfe0d687-902e-4ba2-acdd-cafd20e73f89 tempest-GroupSnapshotsTest-830225659 None] Delete group completed successfully. Jul 10 04:35:08 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-b4d4d4eb-bcd5-4f55-86ae-9678703d658a tempest-GroupSnapshotsTest-830225659 None] Group tempest-GroupSnapshotsTest-Group-1491998425: creating Jul 10 04:35:08 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-b4d4d4eb-bcd5-4f55-86ae-9678703d658a tempest-GroupSnapshotsTest-830225659 None] Group tempest-GroupSnapshotsTest-Group-1491998425: created successfully Jul 10 04:35:08 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-b4d4d4eb-bcd5-4f55-86ae-9678703d658a tempest-GroupSnapshotsTest-830225659 None] Create group completed successfully. Jul 10 04:35:10 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:35:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Flow 'volume_create_manager' (81a3d55d-4817-447a-9403-c6d2a3f725c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:35:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a6f3c9-01b0-4727-955b-340a3f3f2e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a6f3c9-01b0-4727-955b-340a3f3f2e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-602761477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6fe1a69d-6dce-4efe-a659-b53052053a90,host='devstack@QuobyteHD#QuobyteHD',id=e2815c13-80e0-471f-8a1c-431393ad2239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5783e30b805c46b88521741eaa5c6c7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:35:11Z,use_quota=True,user_id='db465a938a7f4101ae320ff16479b382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5da5781-b7f8-423a-929b-634f4deb05d1),volume_type_id=f5da5781-b7f8-423a-929b-634f4deb05d1)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (389ad973-c5f8-4953-95a3-5c9a209969e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (389ad973-c5f8-4953-95a3-5c9a209969e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799a36c2-f0f3-4d4e-81bd-385a36659bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799a36c2-f0f3-4d4e-81bd-385a36659bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2815c13-80e0-471f-8a1c-431393ad2239', 'volume_name': 'volume-e2815c13-80e0-471f-8a1c-431393ad2239', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8092943-50ec-4288-92e7-567c120f958d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8092943-50ec-4288-92e7-567c120f958d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a29fbf-ba5a-4111-8360-3a8f7df8300f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:10 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Volume e2815c13-80e0-471f-8a1c-431393ad2239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2815c13-80e0-471f-8a1c-431393ad2239', 'volume_size': 1} Jul 10 04:35:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:35:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:35:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6fe1a69d-6dce-4efe-a659-b53052053a90,created_at=2026-07-10T02:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-602761477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6fe1a69d-6dce-4efe-a659-b53052053a90,host='devstack@QuobyteHD#QuobyteHD',id=e2815c13-80e0-471f-8a1c-431393ad2239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5783e30b805c46b88521741eaa5c6c7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:35:11Z,use_quota=True,user_id='db465a938a7f4101ae320ff16479b382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5da5781-b7f8-423a-929b-634f4deb05d1),volume_type_id=f5da5781-b7f8-423a-929b-634f4deb05d1)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:35:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Creating volume e2815c13-80e0-471f-8a1c-431393ad2239 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:35:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:35:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:35:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:35:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:35:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:35:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:35:10 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:35:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:10 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239 1073741824 Jul 10 04:35:10 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:11 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239 1073741824" returned: 0 in 1.040s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:11 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239 Jul 10 04:35:11 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:12 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-34f91399-355a-4f6e-9496-b170e3931858 tempest-DeleteServersTestJSON-1430660026 None] Acquiring lock "cinder-fb2ee19c-39ea-4797-b5e7-e47b46225737-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:35:12 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-34f91399-355a-4f6e-9496-b170e3931858 tempest-DeleteServersTestJSON-1430660026 None] Lock "cinder-fb2ee19c-39ea-4797-b5e7-e47b46225737-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:35:12 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-34f91399-355a-4f6e-9496-b170e3931858 tempest-DeleteServersTestJSON-1430660026 None] Acquiring lock "cinder-quobyte-fb2ee19c-39ea-4797-b5e7-e47b46225737" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:35:12 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-34f91399-355a-4f6e-9496-b170e3931858 tempest-DeleteServersTestJSON-1430660026 None] Lock "cinder-quobyte-fb2ee19c-39ea-4797-b5e7-e47b46225737" acquired by "delete_volume" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:35:12 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8f51ed-e547-4df1-8c3b-88c316216097]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:35:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-34f91399-355a-4f6e-9496-b170e3931858 tempest-DeleteServersTestJSON-1430660026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fb2ee19c-39ea-4797-b5e7-e47b46225737 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:12 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fb2ee19c-39ea-4797-b5e7-e47b46225737 Jul 10 04:35:12 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:12 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239" returned: 0 in 1.027s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] <== create_volume: return (2155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:35:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.159s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:35:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a29fbf-ba5a-4111-8360-3a8f7df8300f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2815c13-80e0-471f-8a1c-431393ad2239', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8bec90-e424-4a37-bcc1-5130e2f32af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:13 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Volume volume-e2815c13-80e0-471f-8a1c-431393ad2239 (e2815c13-80e0-471f-8a1c-431393ad2239): created successfully Jul 10 04:35:13 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8bec90-e424-4a37-bcc1-5130e2f32af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:13 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Flow 'volume_create_manager' (81a3d55d-4817-447a-9403-c6d2a3f725c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:35:13 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-64f01e36-4abc-4be7-b107-0bbe279ec92f tempest-GroupSnapshotsTest-830225659 None] Created volume successfully. Jul 10 04:35:13 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-34f91399-355a-4f6e-9496-b170e3931858 tempest-DeleteServersTestJSON-1430660026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fb2ee19c-39ea-4797-b5e7-e47b46225737" returned: 0 in 1.091s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-34f91399-355a-4f6e-9496-b170e3931858 tempest-DeleteServersTestJSON-1430660026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fb2ee19c-39ea-4797-b5e7-e47b46225737 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:13 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fb2ee19c-39ea-4797-b5e7-e47b46225737 Jul 10 04:35:13 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:14 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-34f91399-355a-4f6e-9496-b170e3931858 tempest-DeleteServersTestJSON-1430660026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fb2ee19c-39ea-4797-b5e7-e47b46225737" returned: 0 in 0.905s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-34f91399-355a-4f6e-9496-b170e3931858 tempest-DeleteServersTestJSON-1430660026 None] Lock "cinder-quobyte-fb2ee19c-39ea-4797-b5e7-e47b46225737" released by "delete_volume" :: held 2.066s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:35:14 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-34f91399-355a-4f6e-9496-b170e3931858 tempest-DeleteServersTestJSON-1430660026 None] Created reservations ['93af8bbc-85f4-4a85-ab08-d8234d50b623', '436bdb4b-a6b4-4949-bfcf-6dbfcfb30405', '0cf0a30d-73cd-4edf-96c0-ed8d3c3253e9', 'd40a59ee-772d-4a26-b2c1-dab3ee6e49d7'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:35:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-34f91399-355a-4f6e-9496-b170e3931858 tempest-DeleteServersTestJSON-1430660026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:35:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-34f91399-355a-4f6e-9496-b170e3931858 tempest-DeleteServersTestJSON-1430660026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:35:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-34f91399-355a-4f6e-9496-b170e3931858 tempest-DeleteServersTestJSON-1430660026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:35:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-34f91399-355a-4f6e-9496-b170e3931858 tempest-DeleteServersTestJSON-1430660026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:35:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-34f91399-355a-4f6e-9496-b170e3931858 tempest-DeleteServersTestJSON-1430660026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:35:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-34f91399-355a-4f6e-9496-b170e3931858 tempest-DeleteServersTestJSON-1430660026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:14 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:35:14 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:14 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-74096daa-55b6-4684-8af8-d3626a6ab7cf tempest-GroupSnapshotsTest-830225659 None] GroupSnapshot a35f99f2-3502-4b79-b8d8-06295d93f1f9: creating. Jul 10 04:35:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-74096daa-55b6-4684-8af8-d3626a6ab7cf tempest-GroupSnapshotsTest-830225659 None] Group snapshot a35f99f2-3502-4b79-b8d8-06295d93f1f9: creating. {{(pid=87359) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4226}} Jul 10 04:35:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-74096daa-55b6-4684-8af8-d3626a6ab7cf tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:35:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-74096daa-55b6-4684-8af8-d3626a6ab7cf tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:35:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-74096daa-55b6-4684-8af8-d3626a6ab7cf tempest-GroupSnapshotsTest-830225659 None] Creating offline snapshot b1a947fc-2396-41b9-a6cb-ee3bcadea5b6 of volume e2815c13-80e0-471f-8a1c-431393ad2239 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:35:14 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aabcd6-aa7b-4986-ae6c-a1f25a409295]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:35:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-74096daa-55b6-4684-8af8-d3626a6ab7cf tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:15 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239 Jul 10 04:35:15 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:15 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-34f91399-355a-4f6e-9496-b170e3931858 tempest-DeleteServersTestJSON-1430660026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.734s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:15 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-34f91399-355a-4f6e-9496-b170e3931858 tempest-DeleteServersTestJSON-1430660026 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:35:15 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-34f91399-355a-4f6e-9496-b170e3931858 tempest-DeleteServersTestJSON-1430660026 None] Deleted volume successfully. Jul 10 04:35:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-34f91399-355a-4f6e-9496-b170e3931858 tempest-DeleteServersTestJSON-1430660026 None] Lock "cinder-fb2ee19c-39ea-4797-b5e7-e47b46225737-delete_volume" released by "delete_volume" :: held 3.183s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:35:15 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-6f714e44-da08-4654-b800-be12b02db569 tempest-GroupsV314Test-1909515622 None] Group tempest-GroupsV314Test-Group-1372423239: creating Jul 10 04:35:15 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-6f714e44-da08-4654-b800-be12b02db569 tempest-GroupsV314Test-1909515622 None] Group tempest-GroupsV314Test-Group-1372423239: created successfully Jul 10 04:35:15 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-6f714e44-da08-4654-b800-be12b02db569 tempest-GroupsV314Test-1909515622 None] Create group completed successfully. Jul 10 04:35:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:35:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:35:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:35:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:35:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:35:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:35:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:15 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:35:15 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:15 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-74096daa-55b6-4684-8af8-d3626a6ab7cf tempest-GroupSnapshotsTest-830225659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239" returned: 0 in 0.998s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-74096daa-55b6-4684-8af8-d3626a6ab7cf tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.b1a947fc-2396-41b9-a6cb-ee3bcadea5b6 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:15 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.b1a947fc-2396-41b9-a6cb-ee3bcadea5b6 1G Jul 10 04:35:15 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:16 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.714s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:35:16 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-74096daa-55b6-4684-8af8-d3626a6ab7cf tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.b1a947fc-2396-41b9-a6cb-ee3bcadea5b6 1G" returned: 0 in 1.013s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-74096daa-55b6-4684-8af8-d3626a6ab7cf tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2815c13-80e0-471f-8a1c-431393ad2239 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.b1a947fc-2396-41b9-a6cb-ee3bcadea5b6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:17 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2815c13-80e0-471f-8a1c-431393ad2239 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.b1a947fc-2396-41b9-a6cb-ee3bcadea5b6 Jul 10 04:35:17 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:17 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:35:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Flow 'volume_create_manager' (d3d21989-4d08-4bb6-88e3-65ac37ad6bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:35:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c5f604-d1a8-4736-847b-d7482c1c45c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c5f604-d1a8-4736-847b-d7482c1c45c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1555077017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f447853-c37c-4f4c-930f-835a146316b8,host='devstack@QuobyteHD#QuobyteHD',id=7b8255f5-f4aa-4d94-8f35-8a923fd76d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa3bbda3e92646f893af26104a0fcd52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:35:17Z,use_quota=True,user_id='f068a5f531b1476b8e6999919bda9adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfc87de-9e64-49ea-a6df-70474955b282),volume_type_id=3dfc87de-9e64-49ea-a6df-70474955b282)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fc1810-5eb6-4243-9d6c-03e6e77066f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fc1810-5eb6-4243-9d6c-03e6e77066f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7af8c7-fbcd-44be-8256-acae30718e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7af8c7-fbcd-44be-8256-acae30718e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b8255f5-f4aa-4d94-8f35-8a923fd76d77', 'volume_name': 'volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878c6fc7-e1c4-4bf9-a956-bc6ef48344dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878c6fc7-e1c4-4bf9-a956-bc6ef48344dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d111a16a-5e88-4d04-8a8d-6676505cc4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:17 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Volume 7b8255f5-f4aa-4d94-8f35-8a923fd76d77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77', 'volume_size': 1} Jul 10 04:35:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:35:17 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-74096daa-55b6-4684-8af8-d3626a6ab7cf tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2815c13-80e0-471f-8a1c-431393ad2239 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.b1a947fc-2396-41b9-a6cb-ee3bcadea5b6" returned: 0 in 0.958s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:17 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-74096daa-55b6-4684-8af8-d3626a6ab7cf tempest-GroupSnapshotsTest-830225659 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.b1a947fc-2396-41b9-a6cb-ee3bcadea5b6 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:35:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-74096daa-55b6-4684-8af8-d3626a6ab7cf tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.b1a947fc-2396-41b9-a6cb-ee3bcadea5b6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:17 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.b1a947fc-2396-41b9-a6cb-ee3bcadea5b6 Jul 10 04:35:17 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:18 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-74096daa-55b6-4684-8af8-d3626a6ab7cf tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.b1a947fc-2396-41b9-a6cb-ee3bcadea5b6" returned: 0 in 0.701s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-74096daa-55b6-4684-8af8-d3626a6ab7cf tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:18 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.info Jul 10 04:35:18 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:19 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-74096daa-55b6-4684-8af8-d3626a6ab7cf tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.info" returned: 0 in 0.730s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:19 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-74096daa-55b6-4684-8af8-d3626a6ab7cf tempest-GroupSnapshotsTest-830225659 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:35:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-74096daa-55b6-4684-8af8-d3626a6ab7cf tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:19 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.info Jul 10 04:35:19 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:20 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-74096daa-55b6-4684-8af8-d3626a6ab7cf tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.info" returned: 0 in 0.849s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-74096daa-55b6-4684-8af8-d3626a6ab7cf tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.355s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:35:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.575s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:35:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0f447853-c37c-4f4c-930f-835a146316b8,created_at=2026-07-10T02:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1555077017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f447853-c37c-4f4c-930f-835a146316b8,host='devstack@QuobyteHD#QuobyteHD',id=7b8255f5-f4aa-4d94-8f35-8a923fd76d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa3bbda3e92646f893af26104a0fcd52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:35:17Z,use_quota=True,user_id='f068a5f531b1476b8e6999919bda9adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfc87de-9e64-49ea-a6df-70474955b282),volume_type_id=3dfc87de-9e64-49ea-a6df-70474955b282)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:35:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Creating volume 7b8255f5-f4aa-4d94-8f35-8a923fd76d77 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:35:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:35:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:35:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:35:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:35:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:35:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:35:20 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:35:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:20 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 1073741824 Jul 10 04:35:20 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:20 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-74096daa-55b6-4684-8af8-d3626a6ab7cf tempest-GroupSnapshotsTest-830225659 None] group_snapshot a35f99f2-3502-4b79-b8d8-06295d93f1f9: created successfully Jul 10 04:35:21 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:21 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] group_snapshot a35f99f2-3502-4b79-b8d8-06295d93f1f9: deleting Jul 10 04:35:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 1073741824" returned: 0 in 1.220s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] group_snapshot a35f99f2-3502-4b79-b8d8-06295d93f1f9: deleting {{(pid=87359) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4401}} Jul 10 04:35:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:21 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "cinder-quobyte-e2815c13-80e0-471f-8a1c-431393ad2239" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:35:21 devstack sudo[90347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 Jul 10 04:35:21 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-e2815c13-80e0-471f-8a1c-431393ad2239" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:35:21 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "cinder-quobyte-b1a947fc-2396-41b9-a6cb-ee3bcadea5b6" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:35:21 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:21 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-b1a947fc-2396-41b9-a6cb-ee3bcadea5b6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:35:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] Deleting offline snapshot b1a947fc-2396-41b9-a6cb-ee3bcadea5b6 of volume e2815c13-80e0-471f-8a1c-431393ad2239 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:35:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] snapshot_file for this snap is: volume-e2815c13-80e0-471f-8a1c-431393ad2239.b1a947fc-2396-41b9-a6cb-ee3bcadea5b6 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:35:21 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ab581d-e1dc-4212-b608-2f8a366094a8]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:35:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.b1a947fc-2396-41b9-a6cb-ee3bcadea5b6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:21 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.b1a947fc-2396-41b9-a6cb-ee3bcadea5b6 Jul 10 04:35:21 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:22 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77" returned: 0 in 0.815s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:35:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.140s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:35:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d111a16a-5e88-4d04-8a8d-6676505cc4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c221ad-081f-453f-bffb-6bcdb109d4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:22 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Volume volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 (7b8255f5-f4aa-4d94-8f35-8a923fd76d77): created successfully Jul 10 04:35:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c221ad-081f-453f-bffb-6bcdb109d4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Flow 'volume_create_manager' (d3d21989-4d08-4bb6-88e3-65ac37ad6bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:35:22 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c4aa88f4-5362-4463-9b92-d45366ae5c45 tempest-GroupsV314Test-1909515622 None] Created volume successfully. Jul 10 04:35:22 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.b1a947fc-2396-41b9-a6cb-ee3bcadea5b6" returned: 0 in 1.190s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2815c13-80e0-471f-8a1c-431393ad2239(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:35:22 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53354cc-f3a4-4a9a-867d-a7c09b91994e]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:35:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:23 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239 Jul 10 04:35:23 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:24 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239" returned: 0 in 1.096s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.b1a947fc-2396-41b9-a6cb-ee3bcadea5b6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:24 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.b1a947fc-2396-41b9-a6cb-ee3bcadea5b6 Jul 10 04:35:24 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:35:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:35:24 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Cloning volume 7b8255f5-f4aa-4d94-8f35-8a923fd76d77 to volume 646e11e3-a64a-48b4-b8d9-1eeac31ca3c8 Jul 10 04:35:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Creating offline snapshot f4dd4918-6250-4716-b0a2-7f65a3eac94b of volume 7b8255f5-f4aa-4d94-8f35-8a923fd76d77 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:35:24 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b95e81-7f7b-4ad5-8ed6-59b776134cdd]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:35:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:24 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 Jul 10 04:35:24 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:25 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.b1a947fc-2396-41b9-a6cb-ee3bcadea5b6" returned: 0 in 1.164s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.b1a947fc-2396-41b9-a6cb-ee3bcadea5b6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:25 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.b1a947fc-2396-41b9-a6cb-ee3bcadea5b6 Jul 10 04:35:25 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:25 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77" returned: 0 in 1.002s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:25 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b 1G Jul 10 04:35:25 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:26 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239.b1a947fc-2396-41b9-a6cb-ee3bcadea5b6" returned: 0 in 0.844s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:26 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-b1a947fc-2396-41b9-a6cb-ee3bcadea5b6" released by "_delete_snapshot" :: held 4.440s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:35:26 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-e2815c13-80e0-471f-8a1c-431393ad2239" released by "delete_snapshot" :: held 4.480s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:35:26 devstack cinder-volume[87359]: WARNING cinder.quota [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2130412127 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2130412127, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:35:26 devstack cinder-volume[87359]: WARNING cinder.quota [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2130412127 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2130412127, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:35:26 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] Created reservations ['404a3c15-b003-4cf2-9e3f-af3c665c94d8', '5188f8fa-7be9-4fd6-a0cc-c1707c0d99b7', '60849462-5f35-4827-abce-8b7f440d9aec', 'd116f6b4-2c38-489a-beb4-29b5e0cfe3f8'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:35:26 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-5a2fb60a-0589-4dac-b8e0-056b714ef26b tempest-GroupSnapshotsTest-830225659 None] group_snapshot a35f99f2-3502-4b79-b8d8-06295d93f1f9: deleted successfully Jul 10 04:35:26 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b 1G" returned: 0 in 1.009s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:26 devstack sudo[90380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b Jul 10 04:35:26 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:27 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b" returned: 0 in 0.831s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:27 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:35:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:27 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b Jul 10 04:35:27 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f899ce92-cd49-4b38-b959-f5b1b7009405 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "cinder-quobyte-e2815c13-80e0-471f-8a1c-431393ad2239" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:35:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f899ce92-cd49-4b38-b959-f5b1b7009405 tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-e2815c13-80e0-471f-8a1c-431393ad2239" acquired by "delete_volume" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:35:27 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[6178564d-aae7-4d55-9743-54b2cb48350f]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:35:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f899ce92-cd49-4b38-b959-f5b1b7009405 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:27 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239 Jul 10 04:35:27 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:28 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b" returned: 0 in 0.884s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:28 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.info Jul 10 04:35:28 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:28 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f899ce92-cd49-4b38-b959-f5b1b7009405 tempest-GroupSnapshotsTest-830225659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239" returned: 0 in 1.008s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f899ce92-cd49-4b38-b959-f5b1b7009405 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:28 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239 Jul 10 04:35:28 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:29 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.info" returned: 0 in 0.923s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:29 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:29 devstack sudo[90406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.info Jul 10 04:35:29 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:29 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f899ce92-cd49-4b38-b959-f5b1b7009405 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2815c13-80e0-471f-8a1c-431393ad2239" returned: 0 in 0.703s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f899ce92-cd49-4b38-b959-f5b1b7009405 tempest-GroupSnapshotsTest-830225659 None] Lock "cinder-quobyte-e2815c13-80e0-471f-8a1c-431393ad2239" released by "delete_volume" :: held 1.823s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-f899ce92-cd49-4b38-b959-f5b1b7009405 tempest-GroupSnapshotsTest-830225659 None] Created reservations ['5f8e3b80-962f-476e-9604-adb808bd0804'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:35:29 devstack cinder-volume[87359]: WARNING cinder.quota [None req-f899ce92-cd49-4b38-b959-f5b1b7009405 tempest-GroupSnapshotsTest-830225659 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2130412127 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2130412127, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-f899ce92-cd49-4b38-b959-f5b1b7009405 tempest-GroupSnapshotsTest-830225659 None] Created reservations ['cc0505d4-a41c-499b-8cb7-c07a783d712c', 'b577d15b-fc70-4f89-a349-91f03013c289', 'fb8bec5f-7c87-4bdf-8981-ee57c025245f', '7905325a-b298-4130-8fbc-76f83f2f5539'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f899ce92-cd49-4b38-b959-f5b1b7009405 tempest-GroupSnapshotsTest-830225659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f899ce92-cd49-4b38-b959-f5b1b7009405 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f899ce92-cd49-4b38-b959-f5b1b7009405 tempest-GroupSnapshotsTest-830225659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f899ce92-cd49-4b38-b959-f5b1b7009405 tempest-GroupSnapshotsTest-830225659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f899ce92-cd49-4b38-b959-f5b1b7009405 tempest-GroupSnapshotsTest-830225659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f899ce92-cd49-4b38-b959-f5b1b7009405 tempest-GroupSnapshotsTest-830225659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:29 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.info" returned: 0 in 0.739s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:29 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:35:29 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Acquiring lock "cinder-quobyte-646e11e3-a64a-48b4-b8d9-1eeac31ca3c8" by "_copy_volume_from_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Lock "cinder-quobyte-646e11e3-a64a-48b4-b8d9-1eeac31ca3c8" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] snapshot: f4dd4918-6250-4716-b0a2-7f65a3eac94b, volume: 646e11e3-a64a-48b4-b8d9-1eeac31ca3c8, {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da6c1d3-6cd1-47f5-83fa-88efc8ff3cf6]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:35:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:30 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b Jul 10 04:35:30 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:30 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f899ce92-cd49-4b38-b959-f5b1b7009405 tempest-GroupSnapshotsTest-830225659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.779s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:30 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-f899ce92-cd49-4b38-b959-f5b1b7009405 tempest-GroupSnapshotsTest-830225659 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:35:30 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-f899ce92-cd49-4b38-b959-f5b1b7009405 tempest-GroupSnapshotsTest-830225659 None] Delete group completed successfully. Jul 10 04:35:30 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b" returned: 0 in 0.889s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:30 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:35:30 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 04:35:30 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Creating direct copy from snapshot {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 04:35:30 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[a383ac45-feb1-4707-8899-bc07738b88e0]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:35:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:30 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 Jul 10 04:35:30 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:31 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77" returned: 0 in 0.899s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:31 devstack cinder-volume[87359]: DEBUG cinder.utils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Path /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-646e11e3-a64a-48b4-b8d9-1eeac31ca3c8 not found in is_blk_device check {{(pid=87359) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 04:35:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-646e11e3-a64a-48b4-b8d9-1eeac31ca3c8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:31 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-646e11e3-a64a-48b4-b8d9-1eeac31ca3c8 Jul 10 04:35:31 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:38 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-646e11e3-a64a-48b4-b8d9-1eeac31ca3c8" returned: 0 in 6.758s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:38 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a43b5b-4aa2-4b0b-9a66-29367dbd9612]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:35:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:38 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 Jul 10 04:35:38 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:39 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77" returned: 0 in 1.153s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:39 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77, size 1024.00 MB, duration 6.76 sec, destination /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-646e11e3-a64a-48b4-b8d9-1eeac31ca3c8 {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:35:39 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Converted 1024.00 MB image at 151.46 MB/s Jul 10 04:35:39 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-646e11e3-a64a-48b4-b8d9-1eeac31ca3c8 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:35:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-646e11e3-a64a-48b4-b8d9-1eeac31ca3c8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:39 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-646e11e3-a64a-48b4-b8d9-1eeac31ca3c8 Jul 10 04:35:39 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:39 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:INSERT=17,cinder:UPDATE=81,cinder:DELETE=2,cinder:SELECT=68 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:35:39 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=69,cinder:UPDATE=69,cinder:INSERT=19,cinder:DELETE=2 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:35:40 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-646e11e3-a64a-48b4-b8d9-1eeac31ca3c8" returned: 0 in 0.793s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:40 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Lock "cinder-quobyte-646e11e3-a64a-48b4-b8d9-1eeac31ca3c8" released by "_copy_volume_from_snapshot" :: held 10.621s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:35:40 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Acquiring lock "cinder-quobyte-f4dd4918-6250-4716-b0a2-7f65a3eac94b" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:35:40 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Lock "cinder-quobyte-f4dd4918-6250-4716-b0a2-7f65a3eac94b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:35:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Deleting offline snapshot f4dd4918-6250-4716-b0a2-7f65a3eac94b of volume 7b8255f5-f4aa-4d94-8f35-8a923fd76d77 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:35:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] snapshot_file for this snap is: volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:35:40 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad08f851-2a61-4556-b06b-f307379e7410]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:35:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:40 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b Jul 10 04:35:40 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:41 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b" returned: 0 in 1.027s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:35:41 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2dadb0-70e1-4d05-84ba-b62757cdc869]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:35:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:41 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 Jul 10 04:35:41 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:42 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c23bc6df-7ccb-4007-b6ec-b4f54847a4a3 tempest-GroupSnapshotsV319Test-298866152 None] Group tempest-GroupSnapshotsV319Test-Group-135881618: creating Jul 10 04:35:42 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c23bc6df-7ccb-4007-b6ec-b4f54847a4a3 tempest-GroupSnapshotsV319Test-298866152 None] Group tempest-GroupSnapshotsV319Test-Group-135881618: created successfully Jul 10 04:35:42 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c23bc6df-7ccb-4007-b6ec-b4f54847a4a3 tempest-GroupSnapshotsV319Test-298866152 None] Create group completed successfully. Jul 10 04:35:42 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77" returned: 0 in 1.169s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:42 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b Jul 10 04:35:42 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:43 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b" returned: 0 in 1.050s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:43 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b Jul 10 04:35:43 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Flow 'volume_create_manager' (8745ee99-bbcf-4cdb-be73-6b6e9d524234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce48d703-b6b6-4b5c-89a4-e6435a03f4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:44 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77.f4dd4918-6250-4716-b0a2-7f65a3eac94b" returned: 0 in 0.914s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce48d703-b6b6-4b5c-89a4-e6435a03f4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1123207885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=756aae2d-632b-4f58-ba2a-82602d7af065,host='devstack@QuobyteHD#QuobyteHD',id=39c10d9e-f7fc-400b-aa24-e7e79b309769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc04fce2e0d47ada472069f4ab674a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:35:45Z,use_quota=True,user_id='cced4f9c37c04e69885757d0abe8745a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(064d1f37-5ada-4ed0-b502-ed6009d39ab6),volume_type_id=064d1f37-5ada-4ed0-b502-ed6009d39ab6)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a03e91-a28e-4b76-be18-c813e8a66277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a03e91-a28e-4b76-be18-c813e8a66277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f45894f-bdfc-4dfa-af36-d9677ffc2536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f45894f-bdfc-4dfa-af36-d9677ffc2536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39c10d9e-f7fc-400b-aa24-e7e79b309769', 'volume_name': 'volume-39c10d9e-f7fc-400b-aa24-e7e79b309769', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37692a3d-400d-448c-9ad2-0e35e96c4b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37692a3d-400d-448c-9ad2-0e35e96c4b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1836722f-bb49-45f5-b3c0-becab75f5b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:44 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Volume 39c10d9e-f7fc-400b-aa24-e7e79b309769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39c10d9e-f7fc-400b-aa24-e7e79b309769', 'volume_size': 1} Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Lock "cinder-quobyte-f4dd4918-6250-4716-b0a2-7f65a3eac94b" released by "_delete_snapshot" :: held 4.388s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.659s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=756aae2d-632b-4f58-ba2a-82602d7af065,created_at=2026-07-10T02:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1123207885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=756aae2d-632b-4f58-ba2a-82602d7af065,host='devstack@QuobyteHD#QuobyteHD',id=39c10d9e-f7fc-400b-aa24-e7e79b309769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc04fce2e0d47ada472069f4ab674a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:35:45Z,use_quota=True,user_id='cced4f9c37c04e69885757d0abe8745a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(064d1f37-5ada-4ed0-b502-ed6009d39ab6),volume_type_id=064d1f37-5ada-4ed0-b502-ed6009d39ab6)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Creating volume 39c10d9e-f7fc-400b-aa24-e7e79b309769 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:35:44 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:35:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:44 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769 1073741824 Jul 10 04:35:44 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:45 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-780b481d-34a8-4158-b5b2-a85b7fbc09cc tempest-GroupsV314Test-1909515622 None] Create group from source-group-0f447853-c37c-4f4c-930f-835a146316b8 completed successfully. Jul 10 04:35:45 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769 1073741824" returned: 0 in 1.087s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:46 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769 Jul 10 04:35:46 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:46 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-aa737649-137f-4f9f-bbad-c1735d691741 tempest-GroupsV314Test-1909515622 None] Acquiring lock "cinder-quobyte-646e11e3-a64a-48b4-b8d9-1eeac31ca3c8" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:35:46 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-aa737649-137f-4f9f-bbad-c1735d691741 tempest-GroupsV314Test-1909515622 None] Lock "cinder-quobyte-646e11e3-a64a-48b4-b8d9-1eeac31ca3c8" acquired by "delete_volume" :: waited 0.037s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:35:46 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e51eab-7669-4fd5-9bde-1cf27ee2214e]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:35:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-aa737649-137f-4f9f-bbad-c1735d691741 tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-646e11e3-a64a-48b4-b8d9-1eeac31ca3c8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:46 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-646e11e3-a64a-48b4-b8d9-1eeac31ca3c8 Jul 10 04:35:46 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:47 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769" returned: 0 in 0.962s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] <== create_volume: return (2124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:35:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.132s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:35:47 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1836722f-bb49-45f5-b3c0-becab75f5b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39c10d9e-f7fc-400b-aa24-e7e79b309769', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:47 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e458870-6b07-454c-b2a6-e7a159297ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:47 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Volume volume-39c10d9e-f7fc-400b-aa24-e7e79b309769 (39c10d9e-f7fc-400b-aa24-e7e79b309769): created successfully Jul 10 04:35:47 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e458870-6b07-454c-b2a6-e7a159297ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:47 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Flow 'volume_create_manager' (8745ee99-bbcf-4cdb-be73-6b6e9d524234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:35:47 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-90b3cba6-613d-48da-af6b-a81ed3048838 tempest-GroupSnapshotsV319Test-298866152 None] Created volume successfully. Jul 10 04:35:47 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-aa737649-137f-4f9f-bbad-c1735d691741 tempest-GroupsV314Test-1909515622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-646e11e3-a64a-48b4-b8d9-1eeac31ca3c8" returned: 0 in 1.312s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-aa737649-137f-4f9f-bbad-c1735d691741 tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-646e11e3-a64a-48b4-b8d9-1eeac31ca3c8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:47 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-646e11e3-a64a-48b4-b8d9-1eeac31ca3c8 Jul 10 04:35:47 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:48 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-aa737649-137f-4f9f-bbad-c1735d691741 tempest-GroupsV314Test-1909515622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-646e11e3-a64a-48b4-b8d9-1eeac31ca3c8" returned: 0 in 0.739s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:48 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-aa737649-137f-4f9f-bbad-c1735d691741 tempest-GroupsV314Test-1909515622 None] Lock "cinder-quobyte-646e11e3-a64a-48b4-b8d9-1eeac31ca3c8" released by "delete_volume" :: held 2.113s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:35:48 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-aa737649-137f-4f9f-bbad-c1735d691741 tempest-GroupsV314Test-1909515622 None] Created reservations ['ad00fc1d-802c-4ea5-acfd-4daefc7e6714'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:35:48 devstack cinder-volume[87359]: WARNING cinder.quota [None req-aa737649-137f-4f9f-bbad-c1735d691741 tempest-GroupsV314Test-1909515622 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1299458554 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1299458554, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:35:48 devstack cinder-volume[87359]: WARNING cinder.quota [None req-aa737649-137f-4f9f-bbad-c1735d691741 tempest-GroupsV314Test-1909515622 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1299458554 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1299458554, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:35:48 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-aa737649-137f-4f9f-bbad-c1735d691741 tempest-GroupsV314Test-1909515622 None] Created reservations ['6ec61a17-7e0d-487e-82d6-f8df67237430', '18db5822-4f05-4e8d-be24-232af37a8ea7', 'f590a214-4b05-496b-8652-df570334cc2f', 'e452c0f8-f7ee-4363-b682-f6968f3d158b'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:35:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-aa737649-137f-4f9f-bbad-c1735d691741 tempest-GroupsV314Test-1909515622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:35:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-aa737649-137f-4f9f-bbad-c1735d691741 tempest-GroupsV314Test-1909515622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:35:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-aa737649-137f-4f9f-bbad-c1735d691741 tempest-GroupsV314Test-1909515622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:35:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-aa737649-137f-4f9f-bbad-c1735d691741 tempest-GroupsV314Test-1909515622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:35:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-aa737649-137f-4f9f-bbad-c1735d691741 tempest-GroupsV314Test-1909515622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:35:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-aa737649-137f-4f9f-bbad-c1735d691741 tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:48 devstack sudo[90582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:35:48 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:49 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-e3853798-ec45-4557-956d-c5498b454239 tempest-GroupSnapshotsV319Test-298866152 None] GroupSnapshot fa8fe84a-c90b-4873-b6fb-ee769e55f175: creating. Jul 10 04:35:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e3853798-ec45-4557-956d-c5498b454239 tempest-GroupSnapshotsV319Test-298866152 None] Group snapshot fa8fe84a-c90b-4873-b6fb-ee769e55f175: creating. {{(pid=87359) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4226}} Jul 10 04:35:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e3853798-ec45-4557-956d-c5498b454239 tempest-GroupSnapshotsV319Test-298866152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:35:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e3853798-ec45-4557-956d-c5498b454239 tempest-GroupSnapshotsV319Test-298866152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:35:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-e3853798-ec45-4557-956d-c5498b454239 tempest-GroupSnapshotsV319Test-298866152 None] Creating offline snapshot 5ee9de2f-20ed-4e88-966c-007eabf9e154 of volume 39c10d9e-f7fc-400b-aa24-e7e79b309769 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:35:49 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d354ea-e52c-4b95-824f-7fcfddc593bc]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:35:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e3853798-ec45-4557-956d-c5498b454239 tempest-GroupSnapshotsV319Test-298866152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:49 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a475f8bc-2ea6-4aba-b10f-c539c679e1b0 tempest-GroupsV314Test-1909515622 None] Acquiring lock "cinder-quobyte-7b8255f5-f4aa-4d94-8f35-8a923fd76d77" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:35:49 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a475f8bc-2ea6-4aba-b10f-c539c679e1b0 tempest-GroupsV314Test-1909515622 None] Lock "cinder-quobyte-7b8255f5-f4aa-4d94-8f35-8a923fd76d77" acquired by "delete_volume" :: waited 0.035s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:35:49 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769 Jul 10 04:35:49 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:49 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaa986c-984e-4778-b264-141511e80dfe]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:35:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a475f8bc-2ea6-4aba-b10f-c539c679e1b0 tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:49 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 Jul 10 04:35:49 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:49 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-aa737649-137f-4f9f-bbad-c1735d691741 tempest-GroupsV314Test-1909515622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.162s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:49 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-aa737649-137f-4f9f-bbad-c1735d691741 tempest-GroupsV314Test-1909515622 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:35:50 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-aa737649-137f-4f9f-bbad-c1735d691741 tempest-GroupsV314Test-1909515622 None] Delete group completed successfully. Jul 10 04:35:50 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e3853798-ec45-4557-956d-c5498b454239 tempest-GroupSnapshotsV319Test-298866152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769" returned: 0 in 1.247s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e3853798-ec45-4557-956d-c5498b454239 tempest-GroupSnapshotsV319Test-298866152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.5ee9de2f-20ed-4e88-966c-007eabf9e154 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:50 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.5ee9de2f-20ed-4e88-966c-007eabf9e154 1G Jul 10 04:35:50 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:50 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a475f8bc-2ea6-4aba-b10f-c539c679e1b0 tempest-GroupsV314Test-1909515622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77" returned: 0 in 1.133s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a475f8bc-2ea6-4aba-b10f-c539c679e1b0 tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:50 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77 Jul 10 04:35:50 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:51 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e3853798-ec45-4557-956d-c5498b454239 tempest-GroupSnapshotsV319Test-298866152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.5ee9de2f-20ed-4e88-966c-007eabf9e154 1G" returned: 0 in 0.912s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e3853798-ec45-4557-956d-c5498b454239 tempest-GroupSnapshotsV319Test-298866152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39c10d9e-f7fc-400b-aa24-e7e79b309769 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.5ee9de2f-20ed-4e88-966c-007eabf9e154 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:51 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39c10d9e-f7fc-400b-aa24-e7e79b309769 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.5ee9de2f-20ed-4e88-966c-007eabf9e154 Jul 10 04:35:51 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:51 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a475f8bc-2ea6-4aba-b10f-c539c679e1b0 tempest-GroupsV314Test-1909515622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7b8255f5-f4aa-4d94-8f35-8a923fd76d77" returned: 0 in 0.986s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a475f8bc-2ea6-4aba-b10f-c539c679e1b0 tempest-GroupsV314Test-1909515622 None] Lock "cinder-quobyte-7b8255f5-f4aa-4d94-8f35-8a923fd76d77" released by "delete_volume" :: held 2.286s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:35:51 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-a475f8bc-2ea6-4aba-b10f-c539c679e1b0 tempest-GroupsV314Test-1909515622 None] Created reservations ['90c9c56a-295c-4581-b329-d2aa3d0a0b25'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:35:51 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-a475f8bc-2ea6-4aba-b10f-c539c679e1b0 tempest-GroupsV314Test-1909515622 None] Created reservations ['2aa03c58-2d26-47c0-b901-9120bffdcfc4', 'a747854c-0a42-43e4-9191-35f9221c68d5', 'a06bde0c-c661-453d-b7f4-b9dba251210d', '012540ef-e8bc-4a3b-b674-27e6464a976e'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:35:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a475f8bc-2ea6-4aba-b10f-c539c679e1b0 tempest-GroupsV314Test-1909515622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:35:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a475f8bc-2ea6-4aba-b10f-c539c679e1b0 tempest-GroupsV314Test-1909515622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:35:52 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a475f8bc-2ea6-4aba-b10f-c539c679e1b0 tempest-GroupsV314Test-1909515622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:35:52 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a475f8bc-2ea6-4aba-b10f-c539c679e1b0 tempest-GroupsV314Test-1909515622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:35:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a475f8bc-2ea6-4aba-b10f-c539c679e1b0 tempest-GroupsV314Test-1909515622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:35:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a475f8bc-2ea6-4aba-b10f-c539c679e1b0 tempest-GroupsV314Test-1909515622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:52 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:35:52 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:52 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e3853798-ec45-4557-956d-c5498b454239 tempest-GroupSnapshotsV319Test-298866152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39c10d9e-f7fc-400b-aa24-e7e79b309769 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.5ee9de2f-20ed-4e88-966c-007eabf9e154" returned: 0 in 0.907s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:52 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-e3853798-ec45-4557-956d-c5498b454239 tempest-GroupSnapshotsV319Test-298866152 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.5ee9de2f-20ed-4e88-966c-007eabf9e154 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:35:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e3853798-ec45-4557-956d-c5498b454239 tempest-GroupSnapshotsV319Test-298866152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.5ee9de2f-20ed-4e88-966c-007eabf9e154 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:52 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.5ee9de2f-20ed-4e88-966c-007eabf9e154 Jul 10 04:35:52 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:53 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a475f8bc-2ea6-4aba-b10f-c539c679e1b0 tempest-GroupsV314Test-1909515622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.619s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:53 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-a475f8bc-2ea6-4aba-b10f-c539c679e1b0 tempest-GroupsV314Test-1909515622 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:35:53 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a475f8bc-2ea6-4aba-b10f-c539c679e1b0 tempest-GroupsV314Test-1909515622 None] Delete group completed successfully. Jul 10 04:35:54 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e3853798-ec45-4557-956d-c5498b454239 tempest-GroupSnapshotsV319Test-298866152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.5ee9de2f-20ed-4e88-966c-007eabf9e154" returned: 0 in 1.635s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e3853798-ec45-4557-956d-c5498b454239 tempest-GroupSnapshotsV319Test-298866152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:54 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.info Jul 10 04:35:54 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:55 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e3853798-ec45-4557-956d-c5498b454239 tempest-GroupSnapshotsV319Test-298866152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.info" returned: 0 in 1.698s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:55 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-e3853798-ec45-4557-956d-c5498b454239 tempest-GroupSnapshotsV319Test-298866152 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:35:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e3853798-ec45-4557-956d-c5498b454239 tempest-GroupSnapshotsV319Test-298866152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:55 devstack sudo[90677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.info Jul 10 04:35:55 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:56 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e3853798-ec45-4557-956d-c5498b454239 tempest-GroupSnapshotsV319Test-298866152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.info" returned: 0 in 0.747s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e3853798-ec45-4557-956d-c5498b454239 tempest-GroupSnapshotsV319Test-298866152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.295s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:35:56 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-e3853798-ec45-4557-956d-c5498b454239 tempest-GroupSnapshotsV319Test-298866152 None] group_snapshot fa8fe84a-c90b-4873-b6fb-ee769e55f175: created successfully Jul 10 04:35:57 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] group_snapshot fa8fe84a-c90b-4873-b6fb-ee769e55f175: deleting Jul 10 04:35:57 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] group_snapshot fa8fe84a-c90b-4873-b6fb-ee769e55f175: deleting {{(pid=87359) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4401}} Jul 10 04:35:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] Acquiring lock "cinder-quobyte-39c10d9e-f7fc-400b-aa24-e7e79b309769" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:35:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] Lock "cinder-quobyte-39c10d9e-f7fc-400b-aa24-e7e79b309769" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:35:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] Acquiring lock "cinder-quobyte-5ee9de2f-20ed-4e88-966c-007eabf9e154" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:35:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] Lock "cinder-quobyte-5ee9de2f-20ed-4e88-966c-007eabf9e154" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:35:57 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] Deleting offline snapshot 5ee9de2f-20ed-4e88-966c-007eabf9e154 of volume 39c10d9e-f7fc-400b-aa24-e7e79b309769 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:35:57 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] snapshot_file for this snap is: volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.5ee9de2f-20ed-4e88-966c-007eabf9e154 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:35:57 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[52870c43-f67d-4467-8034-8c473eb367e0]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:35:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.5ee9de2f-20ed-4e88-966c-007eabf9e154 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:57 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.5ee9de2f-20ed-4e88-966c-007eabf9e154 Jul 10 04:35:57 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:58 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.5ee9de2f-20ed-4e88-966c-007eabf9e154" returned: 0 in 1.115s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39c10d9e-f7fc-400b-aa24-e7e79b309769(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:35:58 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7aa0223-9ca5-48bd-b2c2-698e2914e976]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:35:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:58 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769 Jul 10 04:35:58 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:00 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769" returned: 0 in 1.261s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.5ee9de2f-20ed-4e88-966c-007eabf9e154 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:00 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.5ee9de2f-20ed-4e88-966c-007eabf9e154 Jul 10 04:36:00 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:00 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.5ee9de2f-20ed-4e88-966c-007eabf9e154" returned: 0 in 0.949s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.5ee9de2f-20ed-4e88-966c-007eabf9e154 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:01 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.5ee9de2f-20ed-4e88-966c-007eabf9e154 Jul 10 04:36:01 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:01 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769.5ee9de2f-20ed-4e88-966c-007eabf9e154" returned: 0 in 0.844s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] Lock "cinder-quobyte-5ee9de2f-20ed-4e88-966c-007eabf9e154" released by "_delete_snapshot" :: held 4.310s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:36:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] Lock "cinder-quobyte-39c10d9e-f7fc-400b-aa24-e7e79b309769" released by "delete_snapshot" :: held 4.346s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:36:01 devstack cinder-volume[87359]: WARNING cinder.quota [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-44861472 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-44861472, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:36:01 devstack cinder-volume[87359]: WARNING cinder.quota [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-44861472 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-44861472, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:36:01 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] Created reservations ['9939521b-f793-4296-87d3-a0614853ecae', 'd4ca5ec2-c504-4c92-afa2-4ff0a32ade2f', '24d09882-f889-4e13-97e2-ddb1856df2a5', '64f71f66-91ed-4cec-95d0-ab96c877e802'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:36:02 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-e26d042c-b351-4bc6-92ff-2ecd4fba767f tempest-GroupSnapshotsV319Test-298866152 None] group_snapshot fa8fe84a-c90b-4873-b6fb-ee769e55f175: deleted successfully Jul 10 04:36:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5b15080e-42c6-4dfe-99f6-0979de5def31 tempest-GroupSnapshotsV319Test-298866152 None] Acquiring lock "cinder-quobyte-39c10d9e-f7fc-400b-aa24-e7e79b309769" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:36:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5b15080e-42c6-4dfe-99f6-0979de5def31 tempest-GroupSnapshotsV319Test-298866152 None] Lock "cinder-quobyte-39c10d9e-f7fc-400b-aa24-e7e79b309769" acquired by "delete_volume" :: waited 0.026s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:36:03 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3f4ba8-aa19-4464-8cc3-1e7b513a2a1a]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b15080e-42c6-4dfe-99f6-0979de5def31 tempest-GroupSnapshotsV319Test-298866152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:03 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769 Jul 10 04:36:03 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:04 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b15080e-42c6-4dfe-99f6-0979de5def31 tempest-GroupSnapshotsV319Test-298866152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769" returned: 0 in 1.194s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b15080e-42c6-4dfe-99f6-0979de5def31 tempest-GroupSnapshotsV319Test-298866152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:04 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769 Jul 10 04:36:04 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:05 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b15080e-42c6-4dfe-99f6-0979de5def31 tempest-GroupSnapshotsV319Test-298866152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-39c10d9e-f7fc-400b-aa24-e7e79b309769" returned: 0 in 1.197s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5b15080e-42c6-4dfe-99f6-0979de5def31 tempest-GroupSnapshotsV319Test-298866152 None] Lock "cinder-quobyte-39c10d9e-f7fc-400b-aa24-e7e79b309769" released by "delete_volume" :: held 2.544s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:36:06 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-5b15080e-42c6-4dfe-99f6-0979de5def31 tempest-GroupSnapshotsV319Test-298866152 None] Created reservations ['cb56375a-3a32-483f-8fe6-a52edb314e30'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:36:06 devstack cinder-volume[87359]: WARNING cinder.quota [None req-5b15080e-42c6-4dfe-99f6-0979de5def31 tempest-GroupSnapshotsV319Test-298866152 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-44861472 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-44861472, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:36:06 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-5b15080e-42c6-4dfe-99f6-0979de5def31 tempest-GroupSnapshotsV319Test-298866152 None] Created reservations ['698ba4ac-1865-4faa-84b6-8f8154ac472b', '9e70f7ca-5d6e-4944-bbea-17898d87883b', 'b11a8563-3b5f-48ae-93ae-a36daf5595cf', 'dcdea79e-0db2-45bc-99a6-49608b181715'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:36:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b15080e-42c6-4dfe-99f6-0979de5def31 tempest-GroupSnapshotsV319Test-298866152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b15080e-42c6-4dfe-99f6-0979de5def31 tempest-GroupSnapshotsV319Test-298866152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5b15080e-42c6-4dfe-99f6-0979de5def31 tempest-GroupSnapshotsV319Test-298866152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:36:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5b15080e-42c6-4dfe-99f6-0979de5def31 tempest-GroupSnapshotsV319Test-298866152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:36:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b15080e-42c6-4dfe-99f6-0979de5def31 tempest-GroupSnapshotsV319Test-298866152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b15080e-42c6-4dfe-99f6-0979de5def31 tempest-GroupSnapshotsV319Test-298866152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:06 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:36:06 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:07 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b15080e-42c6-4dfe-99f6-0979de5def31 tempest-GroupSnapshotsV319Test-298866152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.748s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:07 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-5b15080e-42c6-4dfe-99f6-0979de5def31 tempest-GroupSnapshotsV319Test-298866152 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:36:07 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-5b15080e-42c6-4dfe-99f6-0979de5def31 tempest-GroupSnapshotsV319Test-298866152 None] Delete group completed successfully. Jul 10 04:36:09 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:36:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Flow 'volume_create_manager' (ec261f64-5afd-4dad-b77d-6493889c3afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:36:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3973373c-505b-400c-8413-103a30d5db70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3973373c-505b-400c-8413-103a30d5db70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-870817156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb60b610-7167-4fb7-8256-b4e696ff76a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5655074148334012829603cec41f4b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:36:10Z,use_quota=True,user_id='f97a87ba494e4075b4452fd0f564f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b2b21f-9431-4ce7-825d-06600c8ebddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b2b21f-9431-4ce7-825d-06600c8ebddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df99e99-b17d-4bb4-bf30-2a25acfa32a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df99e99-b17d-4bb4-bf30-2a25acfa32a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb60b610-7167-4fb7-8256-b4e696ff76a6', 'volume_name': 'volume-bb60b610-7167-4fb7-8256-b4e696ff76a6', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac48c18f-8203-400e-bdb6-608cb1e78729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac48c18f-8203-400e-bdb6-608cb1e78729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd4d4167-5511-49b2-85af-d645a6cc9a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:09 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Volume bb60b610-7167-4fb7-8256-b4e696ff76a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb60b610-7167-4fb7-8256-b4e696ff76a6', 'volume_size': 1} Jul 10 04:36:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-870817156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb60b610-7167-4fb7-8256-b4e696ff76a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5655074148334012829603cec41f4b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:36:10Z,use_quota=True,user_id='f97a87ba494e4075b4452fd0f564f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:36:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Creating volume bb60b610-7167-4fb7-8256-b4e696ff76a6 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:36:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:36:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:36:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:36:09 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:36:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:10 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6 1073741824 Jul 10 04:36:10 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:11 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6 1073741824" returned: 0 in 1.304s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:11 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6 Jul 10 04:36:11 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:11 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:36:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Flow 'volume_create_manager' (9e9fd13f-621e-4011-8785-571e3743e6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:36:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358991a6-9db6-4c4d-9693-7eb2ebcb948f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358991a6-9db6-4c4d-9693-7eb2ebcb948f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-481774683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55422687-5c0c-418d-8504-d14f31894931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95010628c1a463fa7acabb98ad7863f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:36:11Z,use_quota=True,user_id='4d7a19ffb95f407180abc1d747d8fbc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01205f18-9d05-4861-839a-46ad53b89d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01205f18-9d05-4861-839a-46ad53b89d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74dfd05f-ebb3-4963-9ab0-233183c8d4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74dfd05f-ebb3-4963-9ab0-233183c8d4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55422687-5c0c-418d-8504-d14f31894931', 'volume_name': 'volume-55422687-5c0c-418d-8504-d14f31894931', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (563c0a66-fb88-4d16-b5d3-ef43703f6be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (563c0a66-fb88-4d16-b5d3-ef43703f6be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db6916f-291c-482f-91e0-7c4c5ca0c592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:11 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Volume 55422687-5c0c-418d-8504-d14f31894931: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55422687-5c0c-418d-8504-d14f31894931', 'volume_size': 1} Jul 10 04:36:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:12 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6" returned: 0 in 0.942s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] <== create_volume: return (2310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:36:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.313s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.664s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-481774683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55422687-5c0c-418d-8504-d14f31894931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95010628c1a463fa7acabb98ad7863f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:36:11Z,use_quota=True,user_id='4d7a19ffb95f407180abc1d747d8fbc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:36:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Creating volume 55422687-5c0c-418d-8504-d14f31894931 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:36:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:36:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:36:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:36:12 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:36:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55422687-5c0c-418d-8504-d14f31894931 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:12 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55422687-5c0c-418d-8504-d14f31894931 1073741824 Jul 10 04:36:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd4d4167-5511-49b2-85af-d645a6cc9a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb60b610-7167-4fb7-8256-b4e696ff76a6', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:12 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9f4843-ee5a-45b9-bfb8-a43481812e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:12 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Volume volume-bb60b610-7167-4fb7-8256-b4e696ff76a6 (bb60b610-7167-4fb7-8256-b4e696ff76a6): created successfully Jul 10 04:36:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9f4843-ee5a-45b9-bfb8-a43481812e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Flow 'volume_create_manager' (ec261f64-5afd-4dad-b77d-6493889c3afd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:36:12 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-e78f1029-c146-4847-8d37-881d27815c32 tempest-SnapshotsActionsTest-989577808 None] Created volume successfully. Jul 10 04:36:13 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55422687-5c0c-418d-8504-d14f31894931 1073741824" returned: 0 in 1.244s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f59ad39d-894b-4303-a6e9-c798e2c6ee77 tempest-SnapshotsActionsTest-989577808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55422687-5c0c-418d-8504-d14f31894931 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:13 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55422687-5c0c-418d-8504-d14f31894931 Jul 10 04:36:13 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:14 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-1b3ba556-fa4f-475c-954e-5f2a9560ecc1 tempest-GroupsTest-2135316332 None] Group tempest-Group1-409340643: creating Jul 10 04:36:14 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-1b3ba556-fa4f-475c-954e-5f2a9560ecc1 tempest-GroupsTest-2135316332 None] Group tempest-Group1-409340643: created successfully Jul 10 04:36:14 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-1b3ba556-fa4f-475c-954e-5f2a9560ecc1 tempest-GroupsTest-2135316332 None] Create group completed successfully. Jul 10 04:36:14 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55422687-5c0c-418d-8504-d14f31894931" returned: 0 in 0.932s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] <== create_volume: return (2255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:36:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.260s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f59ad39d-894b-4303-a6e9-c798e2c6ee77 tempest-SnapshotsActionsTest-989577808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.986s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db6916f-291c-482f-91e0-7c4c5ca0c592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55422687-5c0c-418d-8504-d14f31894931', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70961a06-1224-4c6a-90f4-19c66965cabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-f59ad39d-894b-4303-a6e9-c798e2c6ee77 tempest-SnapshotsActionsTest-989577808 None] Creating offline snapshot e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 of volume bb60b610-7167-4fb7-8256-b4e696ff76a6 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:36:14 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Volume volume-55422687-5c0c-418d-8504-d14f31894931 (55422687-5c0c-418d-8504-d14f31894931): created successfully Jul 10 04:36:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70961a06-1224-4c6a-90f4-19c66965cabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Flow 'volume_create_manager' (9e9fd13f-621e-4011-8785-571e3743e6d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:36:14 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60ae397-6c92-4462-abc2-a3f32fa804be]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f59ad39d-894b-4303-a6e9-c798e2c6ee77 tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:14 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-7be79f7e-825a-40d0-a71b-a2d218ca7a86 tempest-ServerActionsTestOtherA-972236372 None] Created volume successfully. Jul 10 04:36:14 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6 Jul 10 04:36:14 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:15 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f59ad39d-894b-4303-a6e9-c798e2c6ee77 tempest-SnapshotsActionsTest-989577808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6" returned: 0 in 0.892s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f59ad39d-894b-4303-a6e9-c798e2c6ee77 tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:15 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 1G Jul 10 04:36:15 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:15 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-9b245e4c-3dae-4674-b682-481cf7a53675 tempest-GroupsTest-2135316332 None] Group tempest-Group2-962830398: creating Jul 10 04:36:15 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-9b245e4c-3dae-4674-b682-481cf7a53675 tempest-GroupsTest-2135316332 None] Group tempest-Group2-962830398: created successfully Jul 10 04:36:15 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-9b245e4c-3dae-4674-b682-481cf7a53675 tempest-GroupsTest-2135316332 None] Create group completed successfully. Jul 10 04:36:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:36:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:36:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:36:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:15 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:36:15 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:16 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f59ad39d-894b-4303-a6e9-c798e2c6ee77 tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 1G" returned: 0 in 0.864s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f59ad39d-894b-4303-a6e9-c798e2c6ee77 tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb60b610-7167-4fb7-8256-b4e696ff76a6 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:16 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb60b610-7167-4fb7-8256-b4e696ff76a6 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 Jul 10 04:36:16 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:16 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.730s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:36:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:36:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 8 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:36:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:36:17 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f59ad39d-894b-4303-a6e9-c798e2c6ee77 tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb60b610-7167-4fb7-8256-b4e696ff76a6 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3" returned: 0 in 0.696s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:17 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-f59ad39d-894b-4303-a6e9-c798e2c6ee77 tempest-SnapshotsActionsTest-989577808 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 is being set with open permissions: ugo+rw Jul 10 04:36:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f59ad39d-894b-4303-a6e9-c798e2c6ee77 tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:17 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 Jul 10 04:36:17 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:17 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:36:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Flow 'volume_create_manager' (7cd16c5a-10cf-4edb-a4b3-93d7ebfdf7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:36:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d7027ad-0b8b-4987-95cd-6e03d2eeabef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d7027ad-0b8b-4987-95cd-6e03d2eeabef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1718047086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aad30efd-de30-4a99-8c55-4cc67ade0d11,host='devstack@QuobyteHD#QuobyteHD',id=f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedda2cee4b441959000d660f3f3f54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:36:17Z,use_quota=True,user_id='4b3b78cc2f1448bea88955ef44c08958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec359a2b-8300-4078-a4de-1f358108ca4f),volume_type_id=ec359a2b-8300-4078-a4de-1f358108ca4f)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e083818-b760-48a0-ab87-baf046d9f43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e083818-b760-48a0-ab87-baf046d9f43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886314aa-38fc-40e0-8a77-99ebe8305861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886314aa-38fc-40e0-8a77-99ebe8305861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a', 'volume_name': 'volume-f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df6e7c06-57c6-449e-860c-ec5182b3395a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df6e7c06-57c6-449e-860c-ec5182b3395a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16807db9-0ff5-478a-8f64-2181337c9099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:17 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Volume f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a', 'volume_size': 1} Jul 10 04:36:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:17 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f59ad39d-894b-4303-a6e9-c798e2c6ee77 tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3" returned: 0 in 0.693s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f59ad39d-894b-4303-a6e9-c798e2c6ee77 tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:17 devstack sudo[90886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.info Jul 10 04:36:17 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:18 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f59ad39d-894b-4303-a6e9-c798e2c6ee77 tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.info" returned: 0 in 0.622s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:18 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-f59ad39d-894b-4303-a6e9-c798e2c6ee77 tempest-SnapshotsActionsTest-989577808 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.info is being set with open permissions: ugo+rw Jul 10 04:36:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f59ad39d-894b-4303-a6e9-c798e2c6ee77 tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:18 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.info Jul 10 04:36:18 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:19 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f59ad39d-894b-4303-a6e9-c798e2c6ee77 tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.info" returned: 0 in 0.619s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f59ad39d-894b-4303-a6e9-c798e2c6ee77 tempest-SnapshotsActionsTest-989577808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.513s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.588s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aad30efd-de30-4a99-8c55-4cc67ade0d11,created_at=2026-07-10T02:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1718047086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aad30efd-de30-4a99-8c55-4cc67ade0d11,host='devstack@QuobyteHD#QuobyteHD',id=f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedda2cee4b441959000d660f3f3f54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:36:17Z,use_quota=True,user_id='4b3b78cc2f1448bea88955ef44c08958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec359a2b-8300-4078-a4de-1f358108ca4f),volume_type_id=ec359a2b-8300-4078-a4de-1f358108ca4f)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:36:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Creating volume f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:36:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:36:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:36:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:36:19 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:36:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:19 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a 1073741824 Jul 10 04:36:19 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:19 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-f59ad39d-894b-4303-a6e9-c798e2c6ee77 tempest-SnapshotsActionsTest-989577808 None] Create snapshot completed successfully Jul 10 04:36:20 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a 1073741824" returned: 0 in 0.942s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:20 devstack sudo[90900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a Jul 10 04:36:20 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a9eaff2d-ae12-423e-8925-744b52695a98 tempest-SnapshotsActionsTest-989577808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:20 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a" returned: 0 in 0.736s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:36:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a9eaff2d-ae12-423e-8925-744b52695a98 tempest-SnapshotsActionsTest-989577808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.415s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16807db9-0ff5-478a-8f64-2181337c9099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (993b6c47-1793-477f-aefc-a724e14016b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a9eaff2d-ae12-423e-8925-744b52695a98 tempest-SnapshotsActionsTest-989577808 None] Creating offline snapshot baa6cc78-868a-4b6e-af15-0c37990b6332 of volume bb60b610-7167-4fb7-8256-b4e696ff76a6 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:36:20 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Volume volume-f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a (f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a): created successfully Jul 10 04:36:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (993b6c47-1793-477f-aefc-a724e14016b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Flow 'volume_create_manager' (7cd16c5a-10cf-4edb-a4b3-93d7ebfdf7bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:36:20 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[66800883-dfaa-42d8-a7f9-bf1b259c963c]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a9eaff2d-ae12-423e-8925-744b52695a98 tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:20 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-81bd3474-2dcd-44f0-ba35-9dfb7dec686c tempest-GroupsTest-2135316332 None] Created volume successfully. Jul 10 04:36:21 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 Jul 10 04:36:21 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:21 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a9eaff2d-ae12-423e-8925-744b52695a98 tempest-SnapshotsActionsTest-989577808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3" returned: 0 in 0.826s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a9eaff2d-ae12-423e-8925-744b52695a98 tempest-SnapshotsActionsTest-989577808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb60b610-7167-4fb7-8256-b4e696ff76a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:36:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a9eaff2d-ae12-423e-8925-744b52695a98 tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.baa6cc78-868a-4b6e-af15-0c37990b6332 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:21 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.baa6cc78-868a-4b6e-af15-0c37990b6332 1G Jul 10 04:36:21 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-37f6c6d0-bd2d-4116-aa50-1d6861d054b3 tempest-GroupsTest-2135316332 None] Acquiring lock "cinder-quobyte-f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:36:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-37f6c6d0-bd2d-4116-aa50-1d6861d054b3 tempest-GroupsTest-2135316332 None] Lock "cinder-quobyte-f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a" acquired by "delete_volume" :: waited 0.025s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:36:22 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bea377-7575-44d6-b709-7764a5aa1415]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:22 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-37f6c6d0-bd2d-4116-aa50-1d6861d054b3 tempest-GroupsTest-2135316332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a9eaff2d-ae12-423e-8925-744b52695a98 tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.baa6cc78-868a-4b6e-af15-0c37990b6332 1G" returned: 0 in 1.194s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a9eaff2d-ae12-423e-8925-744b52695a98 tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.baa6cc78-868a-4b6e-af15-0c37990b6332 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:22 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.baa6cc78-868a-4b6e-af15-0c37990b6332 Jul 10 04:36:22 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:23 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a Jul 10 04:36:23 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:23 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-37f6c6d0-bd2d-4116-aa50-1d6861d054b3 tempest-GroupsTest-2135316332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a" returned: 0 in 0.832s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-37f6c6d0-bd2d-4116-aa50-1d6861d054b3 tempest-GroupsTest-2135316332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:23 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a9eaff2d-ae12-423e-8925-744b52695a98 tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.baa6cc78-868a-4b6e-af15-0c37990b6332" returned: 0 in 0.830s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:23 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-a9eaff2d-ae12-423e-8925-744b52695a98 tempest-SnapshotsActionsTest-989577808 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.baa6cc78-868a-4b6e-af15-0c37990b6332 is being set with open permissions: ugo+rw Jul 10 04:36:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a9eaff2d-ae12-423e-8925-744b52695a98 tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.baa6cc78-868a-4b6e-af15-0c37990b6332 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:23 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a Jul 10 04:36:23 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:23 devstack sudo[90944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.baa6cc78-868a-4b6e-af15-0c37990b6332 Jul 10 04:36:23 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:24 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-37f6c6d0-bd2d-4116-aa50-1d6861d054b3 tempest-GroupsTest-2135316332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a" returned: 0 in 0.752s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-37f6c6d0-bd2d-4116-aa50-1d6861d054b3 tempest-GroupsTest-2135316332 None] Lock "cinder-quobyte-f6ee17b0-2f93-4b43-9ef1-788f7cb7fd8a" released by "delete_volume" :: held 1.646s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:36:24 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-37f6c6d0-bd2d-4116-aa50-1d6861d054b3 tempest-GroupsTest-2135316332 None] Created reservations ['359b8c3b-b4f4-4f91-95a7-f576f6d69f0e'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:36:24 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a9eaff2d-ae12-423e-8925-744b52695a98 tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.baa6cc78-868a-4b6e-af15-0c37990b6332" returned: 0 in 0.816s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a9eaff2d-ae12-423e-8925-744b52695a98 tempest-SnapshotsActionsTest-989577808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.823s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:24 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a9eaff2d-ae12-423e-8925-744b52695a98 tempest-SnapshotsActionsTest-989577808 None] Create snapshot completed successfully Jul 10 04:36:24 devstack cinder-volume[87359]: WARNING cinder.quota [None req-37f6c6d0-bd2d-4116-aa50-1d6861d054b3 tempest-GroupsTest-2135316332 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1326840298 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1326840298, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:36:24 devstack cinder-volume[87359]: WARNING cinder.quota [None req-37f6c6d0-bd2d-4116-aa50-1d6861d054b3 tempest-GroupsTest-2135316332 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1326840298 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1326840298, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:36:24 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-37f6c6d0-bd2d-4116-aa50-1d6861d054b3 tempest-GroupsTest-2135316332 None] Created reservations ['e1af5220-b1ad-4d02-b8df-211222da4f0a', '1abe5551-dc3e-428b-ab6b-d3fd0987d422', '362456d6-7b6d-4313-a8a5-ec62c8a7432a', '1e736b4b-2c4c-45c4-a61c-8413dd7f36a7'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:36:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-37f6c6d0-bd2d-4116-aa50-1d6861d054b3 tempest-GroupsTest-2135316332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-37f6c6d0-bd2d-4116-aa50-1d6861d054b3 tempest-GroupsTest-2135316332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-37f6c6d0-bd2d-4116-aa50-1d6861d054b3 tempest-GroupsTest-2135316332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:36:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-37f6c6d0-bd2d-4116-aa50-1d6861d054b3 tempest-GroupsTest-2135316332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:36:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-37f6c6d0-bd2d-4116-aa50-1d6861d054b3 tempest-GroupsTest-2135316332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-37f6c6d0-bd2d-4116-aa50-1d6861d054b3 tempest-GroupsTest-2135316332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:24 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:36:24 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:25 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-37f6c6d0-bd2d-4116-aa50-1d6861d054b3 tempest-GroupsTest-2135316332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.644s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:25 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-37f6c6d0-bd2d-4116-aa50-1d6861d054b3 tempest-GroupsTest-2135316332 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:36:25 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-37f6c6d0-bd2d-4116-aa50-1d6861d054b3 tempest-GroupsTest-2135316332 None] Delete group completed successfully. Jul 10 04:36:25 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-470a5f07-3566-4015-94f5-9befee7d7dc0 tempest-GroupsTest-2135316332 None] Created reservations ['f5102c13-0561-4993-bb35-01353c1fba48'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:36:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-470a5f07-3566-4015-94f5-9befee7d7dc0 tempest-GroupsTest-2135316332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-470a5f07-3566-4015-94f5-9befee7d7dc0 tempest-GroupsTest-2135316332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-470a5f07-3566-4015-94f5-9befee7d7dc0 tempest-GroupsTest-2135316332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:36:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-470a5f07-3566-4015-94f5-9befee7d7dc0 tempest-GroupsTest-2135316332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:36:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-470a5f07-3566-4015-94f5-9befee7d7dc0 tempest-GroupsTest-2135316332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-470a5f07-3566-4015-94f5-9befee7d7dc0 tempest-GroupsTest-2135316332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:25 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:36:25 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:25 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] Acquiring lock "cinder-baa6cc78-868a-4b6e-af15-0c37990b6332-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:36:25 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-baa6cc78-868a-4b6e-af15-0c37990b6332-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:36:25 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] Acquiring lock "cinder-quobyte-bb60b610-7167-4fb7-8256-b4e696ff76a6" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:36:25 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-quobyte-bb60b610-7167-4fb7-8256-b4e696ff76a6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:36:25 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] Acquiring lock "cinder-quobyte-baa6cc78-868a-4b6e-af15-0c37990b6332" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:36:25 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-quobyte-baa6cc78-868a-4b6e-af15-0c37990b6332" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:36:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] Deleting offline snapshot baa6cc78-868a-4b6e-af15-0c37990b6332 of volume bb60b610-7167-4fb7-8256-b4e696ff76a6 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] snapshot_file for this snap is: volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.baa6cc78-868a-4b6e-af15-0c37990b6332 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[4befa4a7-6375-4bc9-a5f2-2b9e8c8e7b3e]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.baa6cc78-868a-4b6e-af15-0c37990b6332 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:26 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.baa6cc78-868a-4b6e-af15-0c37990b6332 Jul 10 04:36:26 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:26 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-470a5f07-3566-4015-94f5-9befee7d7dc0 tempest-GroupsTest-2135316332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.090s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-470a5f07-3566-4015-94f5-9befee7d7dc0 tempest-GroupsTest-2135316332 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:36:26 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-470a5f07-3566-4015-94f5-9befee7d7dc0 tempest-GroupsTest-2135316332 None] Delete group completed successfully. Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Flow 'volume_create_manager' (f2977c7a-8dfa-4b7b-a693-902360f42b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3882329-8daa-4303-a764-38af98d6489f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3882329-8daa-4303-a764-38af98d6489f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-853529903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a20a9f-8547-47da-8937-6da875dffa3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15411bf75a4c478c989ad988097dbdfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:36:27Z,use_quota=True,user_id='63f87044dc3342b1abe652a0b60f6d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb4588d-9be4-4dab-93d1-0e1b6a6580ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb4588d-9be4-4dab-93d1-0e1b6a6580ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e02f7bd5-9451-4939-91c3-fdee30974b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e02f7bd5-9451-4939-91c3-fdee30974b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3a20a9f-8547-47da-8937-6da875dffa3d', 'volume_name': 'volume-b3a20a9f-8547-47da-8937-6da875dffa3d', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b175808b-8dfa-462a-a403-5df1d64830bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b175808b-8dfa-462a-a403-5df1d64830bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991b0f06-3c81-47d7-8411-26e1fa74b03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:26 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Volume b3a20a9f-8547-47da-8937-6da875dffa3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3a20a9f-8547-47da-8937-6da875dffa3d', 'volume_size': 1} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-853529903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a20a9f-8547-47da-8937-6da875dffa3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15411bf75a4c478c989ad988097dbdfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:36:27Z,use_quota=True,user_id='63f87044dc3342b1abe652a0b60f6d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Creating volume b3a20a9f-8547-47da-8937-6da875dffa3d {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:36:26 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:36:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b3a20a9f-8547-47da-8937-6da875dffa3d 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:26 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b3a20a9f-8547-47da-8937-6da875dffa3d 1073741824 Jul 10 04:36:26 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:27 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.baa6cc78-868a-4b6e-af15-0c37990b6332" returned: 0 in 1.021s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb60b610-7167-4fb7-8256-b4e696ff76a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:36:27 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f293413-0a68-446d-a86a-7d92ab2dbdb4]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:27 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-86612bd8-4a68-4e6b-9d8f-1c5248f6c9aa tempest-GroupsTest-2135316332 None] Group tempest-GroupsTest-Group-387778720: creating Jul 10 04:36:27 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-86612bd8-4a68-4e6b-9d8f-1c5248f6c9aa tempest-GroupsTest-2135316332 None] Group tempest-GroupsTest-Group-387778720: created successfully Jul 10 04:36:27 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-86612bd8-4a68-4e6b-9d8f-1c5248f6c9aa tempest-GroupsTest-2135316332 None] Create group completed successfully. Jul 10 04:36:27 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 Jul 10 04:36:27 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:27 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b3a20a9f-8547-47da-8937-6da875dffa3d 1073741824" returned: 0 in 1.023s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b3a20a9f-8547-47da-8937-6da875dffa3d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:27 devstack sudo[91015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b3a20a9f-8547-47da-8937-6da875dffa3d Jul 10 04:36:27 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:27 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3" returned: 0 in 0.891s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb60b610-7167-4fb7-8256-b4e696ff76a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:36:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.baa6cc78-868a-4b6e-af15-0c37990b6332 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:28 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.baa6cc78-868a-4b6e-af15-0c37990b6332 Jul 10 04:36:28 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:28 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b3a20a9f-8547-47da-8937-6da875dffa3d" returned: 0 in 0.823s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:36:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.902s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991b0f06-3c81-47d7-8411-26e1fa74b03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3a20a9f-8547-47da-8937-6da875dffa3d', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28fd2a30-1eb6-4357-a317-0a2dad88e39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:28 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Volume volume-b3a20a9f-8547-47da-8937-6da875dffa3d (b3a20a9f-8547-47da-8937-6da875dffa3d): created successfully Jul 10 04:36:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28fd2a30-1eb6-4357-a317-0a2dad88e39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Flow 'volume_create_manager' (f2977c7a-8dfa-4b7b-a693-902360f42b5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:36:28 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-6d062abc-d9ac-4f85-b3ed-ea431a67f4db tempest-AttachVolumeNegativeTest-351970016 None] Created volume successfully. Jul 10 04:36:28 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.baa6cc78-868a-4b6e-af15-0c37990b6332" returned: 0 in 0.972s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.baa6cc78-868a-4b6e-af15-0c37990b6332 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:29 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.baa6cc78-868a-4b6e-af15-0c37990b6332 Jul 10 04:36:29 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Flow 'volume_create_manager' (7aac3696-f658-48ca-8394-fda3423f55cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf9c6ec8-92ba-4c76-8828-3275c07a0341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf9c6ec8-92ba-4c76-8828-3275c07a0341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1561277956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11861adf-4955-4911-8720-fc9e2d822c19,host='devstack@QuobyteHD#QuobyteHD',id=0fd7edff-50fe-441f-81ec-281837e67029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedda2cee4b441959000d660f3f3f54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:36:29Z,use_quota=True,user_id='4b3b78cc2f1448bea88955ef44c08958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0eb5ccca-b862-454f-8124-e9e6af8e1274),volume_type_id=0eb5ccca-b862-454f-8124-e9e6af8e1274)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce4978f-8db1-4116-b5ad-7f04f6993257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce4978f-8db1-4116-b5ad-7f04f6993257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea47a26a-aa2d-4b8d-b492-392db907aa26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea47a26a-aa2d-4b8d-b492-392db907aa26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fd7edff-50fe-441f-81ec-281837e67029', 'volume_name': 'volume-0fd7edff-50fe-441f-81ec-281837e67029', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00893e83-0416-4146-87c3-a2def183916a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00893e83-0416-4146-87c3-a2def183916a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6229580-febd-4fac-994d-9271337d98a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:29 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Volume 0fd7edff-50fe-441f-81ec-281837e67029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fd7edff-50fe-441f-81ec-281837e67029', 'volume_size': 1} Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=11861adf-4955-4911-8720-fc9e2d822c19,created_at=2026-07-10T02:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1561277956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11861adf-4955-4911-8720-fc9e2d822c19,host='devstack@QuobyteHD#QuobyteHD',id=0fd7edff-50fe-441f-81ec-281837e67029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedda2cee4b441959000d660f3f3f54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:36:29Z,use_quota=True,user_id='4b3b78cc2f1448bea88955ef44c08958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0eb5ccca-b862-454f-8124-e9e6af8e1274),volume_type_id=0eb5ccca-b862-454f-8124-e9e6af8e1274)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Creating volume 0fd7edff-50fe-441f-81ec-281837e67029 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:36:29 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0fd7edff-50fe-441f-81ec-281837e67029 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:29 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0fd7edff-50fe-441f-81ec-281837e67029 1073741824 Jul 10 04:36:29 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:29 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.baa6cc78-868a-4b6e-af15-0c37990b6332" returned: 0 in 0.995s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-quobyte-baa6cc78-868a-4b6e-af15-0c37990b6332" released by "_delete_snapshot" :: held 4.033s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:36:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-quobyte-bb60b610-7167-4fb7-8256-b4e696ff76a6" released by "delete_snapshot" :: held 4.070s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:36:30 devstack cinder-volume[87359]: WARNING cinder.quota [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:36:30 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] Created reservations ['a4110ce3-04b1-496b-a319-66dabfa7ea7f', '768cdf09-c43f-4c8f-8c90-4ba2c7cec89b', '06613003-e4f8-466b-8eec-18e7d4e237f8', '0bc2bbd3-b124-4487-a204-254f5a694135'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:36:30 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] Delete snapshot completed successfully. Jul 10 04:36:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a5deb4a4-9c80-40ce-9805-e87658d0be33 tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-baa6cc78-868a-4b6e-af15-0c37990b6332-delete_snapshot" released by "delete_snapshot" :: held 4.278s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:36:30 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0fd7edff-50fe-441f-81ec-281837e67029 1073741824" returned: 0 in 1.126s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0fd7edff-50fe-441f-81ec-281837e67029 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:30 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0fd7edff-50fe-441f-81ec-281837e67029 Jul 10 04:36:30 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d8dccdc0-4e43-4f36-852d-a7d3166917a1 tempest-SnapshotsActionsTest-989577808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:31 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0fd7edff-50fe-441f-81ec-281837e67029" returned: 0 in 0.834s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:31 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] <== create_volume: return (2030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:36:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d8dccdc0-4e43-4f36-852d-a7d3166917a1 tempest-SnapshotsActionsTest-989577808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.459s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6229580-febd-4fac-994d-9271337d98a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd7edff-50fe-441f-81ec-281837e67029', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e8064b-c94d-4633-8d0f-6ee5b3c6cc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:31 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d8dccdc0-4e43-4f36-852d-a7d3166917a1 tempest-SnapshotsActionsTest-989577808 None] Creating offline snapshot 0a57417d-7169-4e5d-88f7-98efae620901 of volume bb60b610-7167-4fb7-8256-b4e696ff76a6 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:36:31 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Volume volume-0fd7edff-50fe-441f-81ec-281837e67029 (0fd7edff-50fe-441f-81ec-281837e67029): created successfully Jul 10 04:36:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e8064b-c94d-4633-8d0f-6ee5b3c6cc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Flow 'volume_create_manager' (7aac3696-f658-48ca-8394-fda3423f55cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:36:31 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d603c3-ca0a-4cf4-a0f9-4ba8685e2356]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d8dccdc0-4e43-4f36-852d-a7d3166917a1 tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:31 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-eb3c7e73-b612-4efc-b79e-3295096e5ba2 tempest-GroupsTest-2135316332 None] Created volume successfully. Jul 10 04:36:31 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 Jul 10 04:36:31 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:32 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d8dccdc0-4e43-4f36-852d-a7d3166917a1 tempest-SnapshotsActionsTest-989577808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3" returned: 0 in 1.033s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d8dccdc0-4e43-4f36-852d-a7d3166917a1 tempest-SnapshotsActionsTest-989577808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb60b610-7167-4fb7-8256-b4e696ff76a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:36:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d8dccdc0-4e43-4f36-852d-a7d3166917a1 tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.0a57417d-7169-4e5d-88f7-98efae620901 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:32 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.0a57417d-7169-4e5d-88f7-98efae620901 1G Jul 10 04:36:32 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:32 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:36:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Flow 'volume_create_manager' (ab344b28-8ca1-411b-b335-6d36de036b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:36:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a560b04e-8c40-451b-8588-755142c73f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a560b04e-8c40-451b-8588-755142c73f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-786923875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11861adf-4955-4911-8720-fc9e2d822c19,host='devstack@QuobyteHD#QuobyteHD',id=8b7b9782-1d54-4f12-a781-2c973d38841a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedda2cee4b441959000d660f3f3f54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:36:32Z,use_quota=True,user_id='4b3b78cc2f1448bea88955ef44c08958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0eb5ccca-b862-454f-8124-e9e6af8e1274),volume_type_id=0eb5ccca-b862-454f-8124-e9e6af8e1274)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e784225-a174-43d7-a72a-2f3f76957a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e784225-a174-43d7-a72a-2f3f76957a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7cad01e-3033-43a9-847a-933b00c15846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7cad01e-3033-43a9-847a-933b00c15846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b7b9782-1d54-4f12-a781-2c973d38841a', 'volume_name': 'volume-8b7b9782-1d54-4f12-a781-2c973d38841a', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb33525-4e0c-4e57-ad15-aa89a7596374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb33525-4e0c-4e57-ad15-aa89a7596374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b710e2-bce2-41f1-98ac-5650ddddaa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:32 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Volume 8b7b9782-1d54-4f12-a781-2c973d38841a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b7b9782-1d54-4f12-a781-2c973d38841a', 'volume_size': 1} Jul 10 04:36:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-0ff8552b-f49f-4aaf-8139-81ddc47a199e req-28143b39-9d9e-4b53-ad9f-cea3361cea8b tempest-AttachVolumeNegativeTest-351970016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:33 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d8dccdc0-4e43-4f36-852d-a7d3166917a1 tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.0a57417d-7169-4e5d-88f7-98efae620901 1G" returned: 0 in 1.098s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d8dccdc0-4e43-4f36-852d-a7d3166917a1 tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.0a57417d-7169-4e5d-88f7-98efae620901 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:33 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.0a57417d-7169-4e5d-88f7-98efae620901 Jul 10 04:36:33 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:34 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d8dccdc0-4e43-4f36-852d-a7d3166917a1 tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.0a57417d-7169-4e5d-88f7-98efae620901" returned: 0 in 0.684s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:34 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-d8dccdc0-4e43-4f36-852d-a7d3166917a1 tempest-SnapshotsActionsTest-989577808 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.0a57417d-7169-4e5d-88f7-98efae620901 is being set with open permissions: ugo+rw Jul 10 04:36:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d8dccdc0-4e43-4f36-852d-a7d3166917a1 tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.0a57417d-7169-4e5d-88f7-98efae620901 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:34 devstack sudo[91072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.0a57417d-7169-4e5d-88f7-98efae620901 Jul 10 04:36:34 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:34 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d8dccdc0-4e43-4f36-852d-a7d3166917a1 tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.0a57417d-7169-4e5d-88f7-98efae620901" returned: 0 in 0.673s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d8dccdc0-4e43-4f36-852d-a7d3166917a1 tempest-SnapshotsActionsTest-989577808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.613s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.237s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=11861adf-4955-4911-8720-fc9e2d822c19,created_at=2026-07-10T02:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-786923875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11861adf-4955-4911-8720-fc9e2d822c19,host='devstack@QuobyteHD#QuobyteHD',id=8b7b9782-1d54-4f12-a781-2c973d38841a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedda2cee4b441959000d660f3f3f54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:36:32Z,use_quota=True,user_id='4b3b78cc2f1448bea88955ef44c08958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0eb5ccca-b862-454f-8124-e9e6af8e1274),volume_type_id=0eb5ccca-b862-454f-8124-e9e6af8e1274)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:36:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Creating volume 8b7b9782-1d54-4f12-a781-2c973d38841a {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:36:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:36:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:36:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:36:34 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:36:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b7b9782-1d54-4f12-a781-2c973d38841a 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:34 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b7b9782-1d54-4f12-a781-2c973d38841a 1073741824 Jul 10 04:36:34 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:34 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d8dccdc0-4e43-4f36-852d-a7d3166917a1 tempest-SnapshotsActionsTest-989577808 None] Create snapshot completed successfully Jul 10 04:36:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] Acquiring lock "cinder-0a57417d-7169-4e5d-88f7-98efae620901-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:36:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-0a57417d-7169-4e5d-88f7-98efae620901-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:36:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] Acquiring lock "cinder-quobyte-bb60b610-7167-4fb7-8256-b4e696ff76a6" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:36:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-quobyte-bb60b610-7167-4fb7-8256-b4e696ff76a6" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:36:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] Acquiring lock "cinder-quobyte-0a57417d-7169-4e5d-88f7-98efae620901" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:36:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-quobyte-0a57417d-7169-4e5d-88f7-98efae620901" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:36:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] Deleting offline snapshot 0a57417d-7169-4e5d-88f7-98efae620901 of volume bb60b610-7167-4fb7-8256-b4e696ff76a6 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:36:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] snapshot_file for this snap is: volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.0a57417d-7169-4e5d-88f7-98efae620901 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:36:35 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da96781-79d0-4909-8897-60a63152c374]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.0a57417d-7169-4e5d-88f7-98efae620901 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:35 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.0a57417d-7169-4e5d-88f7-98efae620901 Jul 10 04:36:35 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:35 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b7b9782-1d54-4f12-a781-2c973d38841a 1073741824" returned: 0 in 0.837s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b7b9782-1d54-4f12-a781-2c973d38841a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:35 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b7b9782-1d54-4f12-a781-2c973d38841a Jul 10 04:36:35 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:36 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.0a57417d-7169-4e5d-88f7-98efae620901" returned: 0 in 0.899s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:36 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb60b610-7167-4fb7-8256-b4e696ff76a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:36:36 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff473800-9071-4a13-9b0a-7e53e2c1ca49]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:36 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b7b9782-1d54-4f12-a781-2c973d38841a" returned: 0 in 0.708s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:36 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:36:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-0ff8552b-f49f-4aaf-8139-81ddc47a199e req-28143b39-9d9e-4b53-ad9f-cea3361cea8b tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.274s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b710e2-bce2-41f1-98ac-5650ddddaa22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b7b9782-1d54-4f12-a781-2c973d38841a', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:36 devstack sudo[91090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 Jul 10 04:36:36 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a64f86b5-684a-4c6d-adfa-bab52905ae1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:36 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[2403dfc4-d103-4430-a531-d92bbe76740b]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-0ff8552b-f49f-4aaf-8139-81ddc47a199e req-28143b39-9d9e-4b53-ad9f-cea3361cea8b tempest-AttachVolumeNegativeTest-351970016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b3a20a9f-8547-47da-8937-6da875dffa3d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:36 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Volume volume-8b7b9782-1d54-4f12-a781-2c973d38841a (8b7b9782-1d54-4f12-a781-2c973d38841a): created successfully Jul 10 04:36:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a64f86b5-684a-4c6d-adfa-bab52905ae1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Flow 'volume_create_manager' (ab344b28-8ca1-411b-b335-6d36de036b05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:36:36 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c3de692d-9174-423a-af26-bdadcedf3247 tempest-GroupsTest-2135316332 None] Created volume successfully. Jul 10 04:36:36 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b3a20a9f-8547-47da-8937-6da875dffa3d Jul 10 04:36:36 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:37 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3" returned: 0 in 0.800s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb60b610-7167-4fb7-8256-b4e696ff76a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:36:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.0a57417d-7169-4e5d-88f7-98efae620901 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:37 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.0a57417d-7169-4e5d-88f7-98efae620901 Jul 10 04:36:37 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:37 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-0ff8552b-f49f-4aaf-8139-81ddc47a199e req-28143b39-9d9e-4b53-ad9f-cea3361cea8b tempest-AttachVolumeNegativeTest-351970016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b3a20a9f-8547-47da-8937-6da875dffa3d" returned: 0 in 0.834s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-0ff8552b-f49f-4aaf-8139-81ddc47a199e req-28143b39-9d9e-4b53-ad9f-cea3361cea8b tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.875s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-0ff8552b-f49f-4aaf-8139-81ddc47a199e req-28143b39-9d9e-4b53-ad9f-cea3361cea8b tempest-AttachVolumeNegativeTest-351970016 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31', 'name': 'volume-b3a20a9f-8547-47da-8937-6da875dffa3d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '796d9093-0267-4a55-a968-3d008e1c0723', 'enforce_multipath': True} {{(pid=87359) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4975}} Jul 10 04:36:37 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-0ff8552b-f49f-4aaf-8139-81ddc47a199e req-28143b39-9d9e-4b53-ad9f-cea3361cea8b tempest-AttachVolumeNegativeTest-351970016 None] attachment_update completed successfully. Jul 10 04:36:37 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-4769cabb-3b56-48e9-93a2-2c5045f54ab3 tempest-GroupsTest-2135316332 None] Update group completed successfully. Jul 10 04:36:38 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.0a57417d-7169-4e5d-88f7-98efae620901" returned: 0 in 0.879s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.0a57417d-7169-4e5d-88f7-98efae620901 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:38 devstack sudo[91173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.0a57417d-7169-4e5d-88f7-98efae620901 Jul 10 04:36:38 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:38 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.0a57417d-7169-4e5d-88f7-98efae620901" returned: 0 in 0.722s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-quobyte-0a57417d-7169-4e5d-88f7-98efae620901" released by "_delete_snapshot" :: held 3.414s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:36:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-quobyte-bb60b610-7167-4fb7-8256-b4e696ff76a6" released by "delete_snapshot" :: held 3.444s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:36:38 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] Created reservations ['d9654751-1869-4e75-af82-1b7e117c9e6c', '31bf2fca-c909-4984-9d00-f1d3880e5219', '4c19ad7c-a0cb-475c-bd8e-85dfd756cf52', '70316b57-c675-4d66-964d-29c1691f5d9b'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:36:38 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] Delete snapshot completed successfully. Jul 10 04:36:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6bdf0c98-c147-46a4-9864-6f862b9ec3df tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-0a57417d-7169-4e5d-88f7-98efae620901-delete_snapshot" released by "delete_snapshot" :: held 3.620s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:36:39 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-3d9efafa-e8de-4c3d-8e11-fc045abba560 tempest-GroupsTest-2135316332 None] Update group completed successfully. Jul 10 04:36:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-645814d9-ab5e-41f9-b0e0-6f1706cd545b tempest-SnapshotsActionsTest-989577808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-645814d9-ab5e-41f9-b0e0-6f1706cd545b tempest-SnapshotsActionsTest-989577808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:39 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=102,cinder:UPDATE=93,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:36:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-645814d9-ab5e-41f9-b0e0-6f1706cd545b tempest-SnapshotsActionsTest-989577808 None] Creating offline snapshot 1ded5a42-15c2-4f4f-8771-cf90282a79e0 of volume bb60b610-7167-4fb7-8256-b4e696ff76a6 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:36:39 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10aec3c-086f-4848-8ca2-e918f89174d4]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-645814d9-ab5e-41f9-b0e0-6f1706cd545b tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:40 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 Jul 10 04:36:40 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:40 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=108,cinder:SELECT=101,cinder:DELETE=6,cinder:INSERT=24 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:36:40 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Acquiring lock "cinder-quobyte-0fd7edff-50fe-441f-81ec-281837e67029" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:36:40 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Lock "cinder-quobyte-0fd7edff-50fe-441f-81ec-281837e67029" acquired by "delete_volume" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:36:40 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab384a85-1c2c-4b15-964f-1803e3a60ce1]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0fd7edff-50fe-441f-81ec-281837e67029 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:40 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-645814d9-ab5e-41f9-b0e0-6f1706cd545b tempest-SnapshotsActionsTest-989577808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3" returned: 0 in 0.983s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-645814d9-ab5e-41f9-b0e0-6f1706cd545b tempest-SnapshotsActionsTest-989577808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb60b610-7167-4fb7-8256-b4e696ff76a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:36:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-645814d9-ab5e-41f9-b0e0-6f1706cd545b tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.1ded5a42-15c2-4f4f-8771-cf90282a79e0 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:40 devstack sudo[91521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.1ded5a42-15c2-4f4f-8771-cf90282a79e0 1G Jul 10 04:36:40 devstack sudo[91521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:41 devstack sudo[91520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0fd7edff-50fe-441f-81ec-281837e67029 Jul 10 04:36:41 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:41 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0fd7edff-50fe-441f-81ec-281837e67029" returned: 0 in 0.811s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0fd7edff-50fe-441f-81ec-281837e67029 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:41 devstack sudo[91530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0fd7edff-50fe-441f-81ec-281837e67029 Jul 10 04:36:41 devstack sudo[91530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:41 devstack sudo[91521]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-645814d9-ab5e-41f9-b0e0-6f1706cd545b tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.1ded5a42-15c2-4f4f-8771-cf90282a79e0 1G" returned: 0 in 0.829s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-645814d9-ab5e-41f9-b0e0-6f1706cd545b tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.1ded5a42-15c2-4f4f-8771-cf90282a79e0 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:41 devstack sudo[91532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.1ded5a42-15c2-4f4f-8771-cf90282a79e0 Jul 10 04:36:41 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:42 devstack sudo[91530]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0fd7edff-50fe-441f-81ec-281837e67029" returned: 0 in 0.688s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Lock "cinder-quobyte-0fd7edff-50fe-441f-81ec-281837e67029" released by "delete_volume" :: held 1.568s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:36:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Acquiring lock "cinder-quobyte-8b7b9782-1d54-4f12-a781-2c973d38841a" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:36:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Lock "cinder-quobyte-8b7b9782-1d54-4f12-a781-2c973d38841a" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:36:42 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:42 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f636747-50d5-47ce-bac7-4325c78bc6d3]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b7b9782-1d54-4f12-a781-2c973d38841a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-645814d9-ab5e-41f9-b0e0-6f1706cd545b tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.1ded5a42-15c2-4f4f-8771-cf90282a79e0" returned: 0 in 0.738s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:42 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-645814d9-ab5e-41f9-b0e0-6f1706cd545b tempest-SnapshotsActionsTest-989577808 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.1ded5a42-15c2-4f4f-8771-cf90282a79e0 is being set with open permissions: ugo+rw Jul 10 04:36:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-645814d9-ab5e-41f9-b0e0-6f1706cd545b tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.1ded5a42-15c2-4f4f-8771-cf90282a79e0 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:42 devstack sudo[91539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.1ded5a42-15c2-4f4f-8771-cf90282a79e0 Jul 10 04:36:42 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:42 devstack sudo[91538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b7b9782-1d54-4f12-a781-2c973d38841a Jul 10 04:36:42 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:43 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-645814d9-ab5e-41f9-b0e0-6f1706cd545b tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.1ded5a42-15c2-4f4f-8771-cf90282a79e0" returned: 0 in 0.714s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-645814d9-ab5e-41f9-b0e0-6f1706cd545b tempest-SnapshotsActionsTest-989577808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.373s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:43 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-645814d9-ab5e-41f9-b0e0-6f1706cd545b tempest-SnapshotsActionsTest-989577808 None] Create snapshot completed successfully Jul 10 04:36:43 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b7b9782-1d54-4f12-a781-2c973d38841a" returned: 0 in 0.898s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b7b9782-1d54-4f12-a781-2c973d38841a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:43 devstack sudo[91546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b7b9782-1d54-4f12-a781-2c973d38841a Jul 10 04:36:43 devstack sudo[91546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:44 devstack sudo[91546]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8b7b9782-1d54-4f12-a781-2c973d38841a" returned: 0 in 0.666s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:44 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Lock "cinder-quobyte-8b7b9782-1d54-4f12-a781-2c973d38841a" released by "delete_volume" :: held 1.615s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:36:44 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Created reservations ['fad71a4a-f583-4b95-bc99-6eb46b4f42c9'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:36:44 devstack cinder-volume[87359]: WARNING cinder.quota [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1525047719 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1525047719, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:36:44 devstack cinder-volume[87359]: WARNING cinder.quota [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1525047719 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1525047719, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:36:44 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Created reservations ['80b43b4f-e7e2-482d-b547-3972b75f2c97', 'f0c9d823-6c7d-49e2-a201-8dd55adcb0cd', '38340b23-b504-4aaa-8d91-e023b54f14f2', '8bf63afc-489d-417e-b061-34b1c8bf8cc5'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:36:44 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] Acquiring lock "cinder-1ded5a42-15c2-4f4f-8771-cf90282a79e0-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:36:44 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-1ded5a42-15c2-4f4f-8771-cf90282a79e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:36:44 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] Acquiring lock "cinder-quobyte-bb60b610-7167-4fb7-8256-b4e696ff76a6" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:36:44 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-quobyte-bb60b610-7167-4fb7-8256-b4e696ff76a6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:36:44 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] Acquiring lock "cinder-quobyte-1ded5a42-15c2-4f4f-8771-cf90282a79e0" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:36:44 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-quobyte-1ded5a42-15c2-4f4f-8771-cf90282a79e0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:36:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] Deleting offline snapshot 1ded5a42-15c2-4f4f-8771-cf90282a79e0 of volume bb60b610-7167-4fb7-8256-b4e696ff76a6 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:36:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] snapshot_file for this snap is: volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.1ded5a42-15c2-4f4f-8771-cf90282a79e0 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:36:44 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59c4806-479c-4966-9d2a-cc64f2c09d38]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.1ded5a42-15c2-4f4f-8771-cf90282a79e0 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:44 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Created reservations ['b88f749b-b37f-493f-b815-6e4572328de7', 'd35ff3b5-e18b-4b19-8272-dad7b7a026d6', 'dc73fb7b-0294-4776-84a5-9095ef3e4ad4', '54ee990e-478e-44e5-88a8-c82127a04688'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:36:44 devstack sudo[91549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.1ded5a42-15c2-4f4f-8771-cf90282a79e0 Jul 10 04:36:44 devstack sudo[91549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:36:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:36:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:44 devstack sudo[91551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:36:44 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:45 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.652s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:45 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:36:45 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-890e602e-d1fb-4817-a717-fb643474790f tempest-GroupsTest-2135316332 None] Delete group completed successfully. Jul 10 04:36:45 devstack sudo[91549]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.1ded5a42-15c2-4f4f-8771-cf90282a79e0" returned: 0 in 0.867s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:45 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb60b610-7167-4fb7-8256-b4e696ff76a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:36:45 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[c905b1f5-6d2c-4545-8586-b21608d96ea8]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:45 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 Jul 10 04:36:45 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:46 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3" returned: 0 in 0.825s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb60b610-7167-4fb7-8256-b4e696ff76a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:36:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.1ded5a42-15c2-4f4f-8771-cf90282a79e0 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:46 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.1ded5a42-15c2-4f4f-8771-cf90282a79e0 Jul 10 04:36:46 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:47 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.1ded5a42-15c2-4f4f-8771-cf90282a79e0" returned: 0 in 0.971s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.1ded5a42-15c2-4f4f-8771-cf90282a79e0 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:47 devstack sudo[91573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.1ded5a42-15c2-4f4f-8771-cf90282a79e0 Jul 10 04:36:47 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:47 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.1ded5a42-15c2-4f4f-8771-cf90282a79e0" returned: 0 in 0.788s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-quobyte-1ded5a42-15c2-4f4f-8771-cf90282a79e0" released by "_delete_snapshot" :: held 3.595s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:36:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-quobyte-bb60b610-7167-4fb7-8256-b4e696ff76a6" released by "delete_snapshot" :: held 3.640s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:36:47 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] Created reservations ['15e0c6d3-9552-4f6b-900a-56e98b4d8872', '8da69937-2400-4363-898b-ea9e27ee4711', 'c9cf8c11-074e-4ba4-952b-937850a7ff15', '20bbb94b-13b4-4e56-ae8c-790f61920860'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:36:48 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] Delete snapshot completed successfully. Jul 10 04:36:48 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1af0f678-83c8-410b-b08b-2bfaad5ecdb1 tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-1ded5a42-15c2-4f4f-8771-cf90282a79e0-delete_snapshot" released by "delete_snapshot" :: held 3.829s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:36:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-51c1ac22-b3bf-46b5-a9c1-39cec32e19de tempest-SnapshotsActionsTest-989577808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-51c1ac22-b3bf-46b5-a9c1-39cec32e19de tempest-SnapshotsActionsTest-989577808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-51c1ac22-b3bf-46b5-a9c1-39cec32e19de tempest-SnapshotsActionsTest-989577808 None] Creating offline snapshot cb57c088-ae12-4f51-b03b-33cded0aa722 of volume bb60b610-7167-4fb7-8256-b4e696ff76a6 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:36:48 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[02004759-65ae-4df9-bbd1-7229622490ab]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-51c1ac22-b3bf-46b5-a9c1-39cec32e19de tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:49 devstack sudo[91577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 Jul 10 04:36:49 devstack sudo[91577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:49 devstack sudo[91577]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-51c1ac22-b3bf-46b5-a9c1-39cec32e19de tempest-SnapshotsActionsTest-989577808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3" returned: 0 in 0.836s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-51c1ac22-b3bf-46b5-a9c1-39cec32e19de tempest-SnapshotsActionsTest-989577808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb60b610-7167-4fb7-8256-b4e696ff76a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:36:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-51c1ac22-b3bf-46b5-a9c1-39cec32e19de tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.cb57c088-ae12-4f51-b03b-33cded0aa722 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:49 devstack sudo[91586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.cb57c088-ae12-4f51-b03b-33cded0aa722 1G Jul 10 04:36:49 devstack sudo[91586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:50 devstack sudo[91586]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-51c1ac22-b3bf-46b5-a9c1-39cec32e19de tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.cb57c088-ae12-4f51-b03b-33cded0aa722 1G" returned: 0 in 0.983s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-51c1ac22-b3bf-46b5-a9c1-39cec32e19de tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.cb57c088-ae12-4f51-b03b-33cded0aa722 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:50 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.cb57c088-ae12-4f51-b03b-33cded0aa722 Jul 10 04:36:50 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:51 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-51c1ac22-b3bf-46b5-a9c1-39cec32e19de tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.cb57c088-ae12-4f51-b03b-33cded0aa722" returned: 0 in 0.815s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:51 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-51c1ac22-b3bf-46b5-a9c1-39cec32e19de tempest-SnapshotsActionsTest-989577808 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.cb57c088-ae12-4f51-b03b-33cded0aa722 is being set with open permissions: ugo+rw Jul 10 04:36:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-51c1ac22-b3bf-46b5-a9c1-39cec32e19de tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.cb57c088-ae12-4f51-b03b-33cded0aa722 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:51 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.cb57c088-ae12-4f51-b03b-33cded0aa722 Jul 10 04:36:51 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:52 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-51c1ac22-b3bf-46b5-a9c1-39cec32e19de tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.cb57c088-ae12-4f51-b03b-33cded0aa722" returned: 0 in 0.668s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-51c1ac22-b3bf-46b5-a9c1-39cec32e19de tempest-SnapshotsActionsTest-989577808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.458s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:52 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-51c1ac22-b3bf-46b5-a9c1-39cec32e19de tempest-SnapshotsActionsTest-989577808 None] Create snapshot completed successfully Jul 10 04:36:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] Acquiring lock "cinder-cb57c088-ae12-4f51-b03b-33cded0aa722-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:36:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-cb57c088-ae12-4f51-b03b-33cded0aa722-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:36:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] Acquiring lock "cinder-quobyte-bb60b610-7167-4fb7-8256-b4e696ff76a6" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:36:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-quobyte-bb60b610-7167-4fb7-8256-b4e696ff76a6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:36:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] Acquiring lock "cinder-quobyte-cb57c088-ae12-4f51-b03b-33cded0aa722" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:36:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-quobyte-cb57c088-ae12-4f51-b03b-33cded0aa722" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:36:53 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] Deleting offline snapshot cb57c088-ae12-4f51-b03b-33cded0aa722 of volume bb60b610-7167-4fb7-8256-b4e696ff76a6 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:36:53 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] snapshot_file for this snap is: volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.cb57c088-ae12-4f51-b03b-33cded0aa722 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:36:53 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc9d72f-c970-4b9d-9cdb-3bd4f8c17372]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.cb57c088-ae12-4f51-b03b-33cded0aa722 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:53 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.cb57c088-ae12-4f51-b03b-33cded0aa722 Jul 10 04:36:53 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:54 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.cb57c088-ae12-4f51-b03b-33cded0aa722" returned: 0 in 0.888s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb60b610-7167-4fb7-8256-b4e696ff76a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:36:54 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da69836-bae0-462c-9d0a-43fa2cc1dafd]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:54 devstack sudo[91631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 Jul 10 04:36:54 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:55 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3" returned: 0 in 0.828s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb60b610-7167-4fb7-8256-b4e696ff76a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:36:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.cb57c088-ae12-4f51-b03b-33cded0aa722 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:55 devstack sudo[91637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.cb57c088-ae12-4f51-b03b-33cded0aa722 Jul 10 04:36:55 devstack sudo[91637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:56 devstack sudo[91637]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.cb57c088-ae12-4f51-b03b-33cded0aa722" returned: 0 in 1.002s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.cb57c088-ae12-4f51-b03b-33cded0aa722 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:56 devstack sudo[91680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.cb57c088-ae12-4f51-b03b-33cded0aa722 Jul 10 04:36:56 devstack sudo[91680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-31943f55-8ead-4547-ad39-60df89cc5e26 req-d6abf39d-2218-4d41-866b-7f1f9bd7b3ee tempest-ServerActionsTestOtherA-972236372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-31943f55-8ead-4547-ad39-60df89cc5e26 req-d6abf39d-2218-4d41-866b-7f1f9bd7b3ee tempest-ServerActionsTestOtherA-972236372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:57 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[c330ce29-801f-41ef-9f15-adcf80039346]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-31943f55-8ead-4547-ad39-60df89cc5e26 req-d6abf39d-2218-4d41-866b-7f1f9bd7b3ee tempest-ServerActionsTestOtherA-972236372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55422687-5c0c-418d-8504-d14f31894931 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:57 devstack sudo[91713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55422687-5c0c-418d-8504-d14f31894931 Jul 10 04:36:57 devstack sudo[91713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:57 devstack sudo[91680]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.cb57c088-ae12-4f51-b03b-33cded0aa722" returned: 0 in 1.058s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-quobyte-cb57c088-ae12-4f51-b03b-33cded0aa722" released by "_delete_snapshot" :: held 3.906s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:36:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-quobyte-bb60b610-7167-4fb7-8256-b4e696ff76a6" released by "delete_snapshot" :: held 3.939s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:36:57 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] Created reservations ['f5278ca8-0031-448f-8dda-c81b09000eb0', '0f01f895-ad1b-4fba-a339-570e3b9859bc', '837b416d-9887-464c-8749-27435919be23', 'f7764462-8f68-40a4-91ab-d7bed9771c80'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:36:57 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] Delete snapshot completed successfully. Jul 10 04:36:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-140c7c89-8d34-463c-9f0f-91b2ee43d67a tempest-SnapshotsActionsTest-2057607556 None] Lock "cinder-cb57c088-ae12-4f51-b03b-33cded0aa722-delete_snapshot" released by "delete_snapshot" :: held 4.123s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:36:57 devstack sudo[91713]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-31943f55-8ead-4547-ad39-60df89cc5e26 req-d6abf39d-2218-4d41-866b-7f1f9bd7b3ee tempest-ServerActionsTestOtherA-972236372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55422687-5c0c-418d-8504-d14f31894931" returned: 0 in 0.846s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-31943f55-8ead-4547-ad39-60df89cc5e26 req-d6abf39d-2218-4d41-866b-7f1f9bd7b3ee tempest-ServerActionsTestOtherA-972236372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.882s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:57 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-31943f55-8ead-4547-ad39-60df89cc5e26 req-d6abf39d-2218-4d41-866b-7f1f9bd7b3ee tempest-ServerActionsTestOtherA-972236372 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31', 'name': 'volume-55422687-5c0c-418d-8504-d14f31894931', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cddd1889-e4cd-4308-b470-c6f2b9dd20cb', 'enforce_multipath': True} {{(pid=87359) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4975}} Jul 10 04:36:58 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-31943f55-8ead-4547-ad39-60df89cc5e26 req-d6abf39d-2218-4d41-866b-7f1f9bd7b3ee tempest-ServerActionsTestOtherA-972236372 None] attachment_update completed successfully. Jul 10 04:36:58 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7027d238-d9f9-45c1-b8d3-30fdb43fbbc9 tempest-SnapshotsActionsTest-989577808 None] Acquiring lock "cinder-e916e2f4-ae1c-4321-b1d9-98d03ca8afd3-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:36:58 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7027d238-d9f9-45c1-b8d3-30fdb43fbbc9 tempest-SnapshotsActionsTest-989577808 None] Lock "cinder-e916e2f4-ae1c-4321-b1d9-98d03ca8afd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:36:58 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7027d238-d9f9-45c1-b8d3-30fdb43fbbc9 tempest-SnapshotsActionsTest-989577808 None] Acquiring lock "cinder-quobyte-bb60b610-7167-4fb7-8256-b4e696ff76a6" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:36:58 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7027d238-d9f9-45c1-b8d3-30fdb43fbbc9 tempest-SnapshotsActionsTest-989577808 None] Lock "cinder-quobyte-bb60b610-7167-4fb7-8256-b4e696ff76a6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:36:58 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7027d238-d9f9-45c1-b8d3-30fdb43fbbc9 tempest-SnapshotsActionsTest-989577808 None] Acquiring lock "cinder-quobyte-e916e2f4-ae1c-4321-b1d9-98d03ca8afd3" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:36:58 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7027d238-d9f9-45c1-b8d3-30fdb43fbbc9 tempest-SnapshotsActionsTest-989577808 None] Lock "cinder-quobyte-e916e2f4-ae1c-4321-b1d9-98d03ca8afd3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:36:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-7027d238-d9f9-45c1-b8d3-30fdb43fbbc9 tempest-SnapshotsActionsTest-989577808 None] Deleting offline snapshot e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 of volume bb60b610-7167-4fb7-8256-b4e696ff76a6 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:36:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-7027d238-d9f9-45c1-b8d3-30fdb43fbbc9 tempest-SnapshotsActionsTest-989577808 None] snapshot_file for this snap is: volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:36:58 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[89df5d17-0e4a-464c-bd54-da657f109f13]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7027d238-d9f9-45c1-b8d3-30fdb43fbbc9 tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:58 devstack sudo[91761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 Jul 10 04:36:58 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:59 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7027d238-d9f9-45c1-b8d3-30fdb43fbbc9 tempest-SnapshotsActionsTest-989577808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3" returned: 0 in 1.085s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:59 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-7027d238-d9f9-45c1-b8d3-30fdb43fbbc9 tempest-SnapshotsActionsTest-989577808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb60b610-7167-4fb7-8256-b4e696ff76a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:36:59 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ad5528-b571-4130-b567-a2ecb55d73ad]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7027d238-d9f9-45c1-b8d3-30fdb43fbbc9 tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:59 devstack sudo[91775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6 Jul 10 04:36:59 devstack sudo[91775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:00 devstack sudo[91775]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7027d238-d9f9-45c1-b8d3-30fdb43fbbc9 tempest-SnapshotsActionsTest-989577808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6" returned: 0 in 1.009s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7027d238-d9f9-45c1-b8d3-30fdb43fbbc9 tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:00 devstack sudo[91788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 Jul 10 04:37:00 devstack sudo[91788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:01 devstack sudo[91788]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7027d238-d9f9-45c1-b8d3-30fdb43fbbc9 tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3" returned: 0 in 1.177s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7027d238-d9f9-45c1-b8d3-30fdb43fbbc9 tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:01 devstack sudo[91812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3 Jul 10 04:37:01 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:02 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7027d238-d9f9-45c1-b8d3-30fdb43fbbc9 tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6.e916e2f4-ae1c-4321-b1d9-98d03ca8afd3" returned: 0 in 0.947s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:02 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7027d238-d9f9-45c1-b8d3-30fdb43fbbc9 tempest-SnapshotsActionsTest-989577808 None] Lock "cinder-quobyte-e916e2f4-ae1c-4321-b1d9-98d03ca8afd3" released by "_delete_snapshot" :: held 4.414s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:02 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7027d238-d9f9-45c1-b8d3-30fdb43fbbc9 tempest-SnapshotsActionsTest-989577808 None] Lock "cinder-quobyte-bb60b610-7167-4fb7-8256-b4e696ff76a6" released by "delete_snapshot" :: held 4.447s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:02 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-7027d238-d9f9-45c1-b8d3-30fdb43fbbc9 tempest-SnapshotsActionsTest-989577808 None] Created reservations ['98ef7c35-86df-475f-981d-ed1cac4e03f7', 'd7d89de0-5fcf-49e8-b0cd-196a57361c7c', 'c51db8d5-97be-4d53-a16f-84706efb2f3e', '8110e9bd-90d3-4a38-8219-30dc17384d9b'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:37:02 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-7027d238-d9f9-45c1-b8d3-30fdb43fbbc9 tempest-SnapshotsActionsTest-989577808 None] Delete snapshot completed successfully. Jul 10 04:37:02 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7027d238-d9f9-45c1-b8d3-30fdb43fbbc9 tempest-SnapshotsActionsTest-989577808 None] Lock "cinder-e916e2f4-ae1c-4321-b1d9-98d03ca8afd3-delete_snapshot" released by "delete_snapshot" :: held 4.744s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-36d3362d-5f60-40d1-8ff0-4d76bdf433fd tempest-SnapshotsActionsTest-989577808 None] Acquiring lock "cinder-bb60b610-7167-4fb7-8256-b4e696ff76a6-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-36d3362d-5f60-40d1-8ff0-4d76bdf433fd tempest-SnapshotsActionsTest-989577808 None] Lock "cinder-bb60b610-7167-4fb7-8256-b4e696ff76a6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-36d3362d-5f60-40d1-8ff0-4d76bdf433fd tempest-SnapshotsActionsTest-989577808 None] Acquiring lock "cinder-quobyte-bb60b610-7167-4fb7-8256-b4e696ff76a6" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-36d3362d-5f60-40d1-8ff0-4d76bdf433fd tempest-SnapshotsActionsTest-989577808 None] Lock "cinder-quobyte-bb60b610-7167-4fb7-8256-b4e696ff76a6" acquired by "delete_volume" :: waited 0.022s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:03 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d65ce2-106a-4595-a07a-377cb6c6d6bf]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-36d3362d-5f60-40d1-8ff0-4d76bdf433fd tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:04 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6 Jul 10 04:37:04 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:05 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-36d3362d-5f60-40d1-8ff0-4d76bdf433fd tempest-SnapshotsActionsTest-989577808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6" returned: 0 in 1.202s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-36d3362d-5f60-40d1-8ff0-4d76bdf433fd tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:05 devstack sudo[91827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6 Jul 10 04:37:05 devstack sudo[91827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:06 devstack sudo[91827]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-36d3362d-5f60-40d1-8ff0-4d76bdf433fd tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bb60b610-7167-4fb7-8256-b4e696ff76a6" returned: 0 in 1.017s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-36d3362d-5f60-40d1-8ff0-4d76bdf433fd tempest-SnapshotsActionsTest-989577808 None] Lock "cinder-quobyte-bb60b610-7167-4fb7-8256-b4e696ff76a6" released by "delete_volume" :: held 2.336s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:06 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-36d3362d-5f60-40d1-8ff0-4d76bdf433fd tempest-SnapshotsActionsTest-989577808 None] Created reservations ['f76c1e13-11ba-48dc-a2b1-b0802be0cab6', 'da549ce6-ec41-4788-bb88-a612e8486597', '39d6ce69-0f66-4328-9834-77f54dbca3c5', '1635819f-c445-4eb1-b006-a02f9c37892b'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:37:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-36d3362d-5f60-40d1-8ff0-4d76bdf433fd tempest-SnapshotsActionsTest-989577808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-36d3362d-5f60-40d1-8ff0-4d76bdf433fd tempest-SnapshotsActionsTest-989577808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-36d3362d-5f60-40d1-8ff0-4d76bdf433fd tempest-SnapshotsActionsTest-989577808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:37:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-36d3362d-5f60-40d1-8ff0-4d76bdf433fd tempest-SnapshotsActionsTest-989577808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:37:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-36d3362d-5f60-40d1-8ff0-4d76bdf433fd tempest-SnapshotsActionsTest-989577808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-36d3362d-5f60-40d1-8ff0-4d76bdf433fd tempest-SnapshotsActionsTest-989577808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:06 devstack sudo[91833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:37:06 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:07 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-36d3362d-5f60-40d1-8ff0-4d76bdf433fd tempest-SnapshotsActionsTest-989577808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.857s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:07 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-36d3362d-5f60-40d1-8ff0-4d76bdf433fd tempest-SnapshotsActionsTest-989577808 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:37:07 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-36d3362d-5f60-40d1-8ff0-4d76bdf433fd tempest-SnapshotsActionsTest-989577808 None] Deleted volume successfully. Jul 10 04:37:07 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-36d3362d-5f60-40d1-8ff0-4d76bdf433fd tempest-SnapshotsActionsTest-989577808 None] Lock "cinder-bb60b610-7167-4fb7-8256-b4e696ff76a6-delete_volume" released by "delete_volume" :: held 3.577s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:07 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-14c8cf0e-95f8-423f-b9ea-8213ff543142 req-e2176c60-ea60-4c01-a8f0-5d261539361e tempest-ServerActionsTestOtherA-972236372 None] Terminate volume connection completed successfully. Jul 10 04:37:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-14c8cf0e-95f8-423f-b9ea-8213ff543142 req-e2176c60-ea60-4c01-a8f0-5d261539361e tempest-ServerActionsTestOtherA-972236372 None] Deleting attachment cddd1889-e4cd-4308-b470-c6f2b9dd20cb. {{(pid=87359) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5106}} Jul 10 04:37:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-14c8cf0e-95f8-423f-b9ea-8213ff543142 req-e6d8ac93-9581-480b-a0d3-1d6c516af485 tempest-ServerActionsTestOtherA-972236372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-14c8cf0e-95f8-423f-b9ea-8213ff543142 req-e6d8ac93-9581-480b-a0d3-1d6c516af485 tempest-ServerActionsTestOtherA-972236372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:10 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb64d587-29dc-4fdf-8cc9-cf26841b82d7]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-14c8cf0e-95f8-423f-b9ea-8213ff543142 req-e6d8ac93-9581-480b-a0d3-1d6c516af485 tempest-ServerActionsTestOtherA-972236372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55422687-5c0c-418d-8504-d14f31894931 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:11 devstack sudo[91883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55422687-5c0c-418d-8504-d14f31894931 Jul 10 04:37:11 devstack sudo[91883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:12 devstack sudo[91883]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-14c8cf0e-95f8-423f-b9ea-8213ff543142 req-e6d8ac93-9581-480b-a0d3-1d6c516af485 tempest-ServerActionsTestOtherA-972236372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55422687-5c0c-418d-8504-d14f31894931" returned: 0 in 1.239s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-14c8cf0e-95f8-423f-b9ea-8213ff543142 req-e6d8ac93-9581-480b-a0d3-1d6c516af485 tempest-ServerActionsTestOtherA-972236372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.262s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-14c8cf0e-95f8-423f-b9ea-8213ff543142 req-e6d8ac93-9581-480b-a0d3-1d6c516af485 tempest-ServerActionsTestOtherA-972236372 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31', 'name': 'volume-55422687-5c0c-418d-8504-d14f31894931', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dd34170e-b025-4a07-b55c-2ebf107dfe44', 'enforce_multipath': True} {{(pid=87359) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4975}} Jul 10 04:37:12 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-14c8cf0e-95f8-423f-b9ea-8213ff543142 req-e6d8ac93-9581-480b-a0d3-1d6c516af485 tempest-ServerActionsTestOtherA-972236372 None] attachment_update completed successfully. Jul 10 04:37:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:37:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:37:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:37:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:15 devstack sudo[91940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:37:15 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:16 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.805s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:37:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:37:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 8 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:37:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:37:17 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:37:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Flow 'volume_create_manager' (f372d06c-4f1d-46c6-91ca-d124a2653112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:37:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5fbb73-d4b4-460a-9c31-4d87652d91aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5fbb73-d4b4-460a-9c31-4d87652d91aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1340952819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e5633a3-fb9c-42dc-9101-2aa28fed8f15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40208ef754474941956120c713c22bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:37:18Z,use_quota=True,user_id='fa39c3c7f33b4e06b5be62645a055f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e3be560-fa6a-4640-b53b-dd6aa91010b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e3be560-fa6a-4640-b53b-dd6aa91010b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4912b4db-ae12-4824-9081-74cae93e2113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4912b4db-ae12-4824-9081-74cae93e2113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e5633a3-fb9c-42dc-9101-2aa28fed8f15', 'volume_name': 'volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5f9284-5ebc-48cc-a65b-9084a8cdc18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5f9284-5ebc-48cc-a65b-9084a8cdc18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb18664d-d778-4e6a-8697-7dbd2e59c6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:17 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Volume 7e5633a3-fb9c-42dc-9101-2aa28fed8f15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15', 'volume_size': 1} Jul 10 04:37:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1340952819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e5633a3-fb9c-42dc-9101-2aa28fed8f15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40208ef754474941956120c713c22bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:37:18Z,use_quota=True,user_id='fa39c3c7f33b4e06b5be62645a055f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:37:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Creating volume 7e5633a3-fb9c-42dc-9101-2aa28fed8f15 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:37:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:37:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:37:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:37:17 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:37:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:17 devstack sudo[91976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15 1073741824 Jul 10 04:37:17 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:18 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15 1073741824" returned: 0 in 0.967s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:18 devstack sudo[91985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15 Jul 10 04:37:18 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:19 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15" returned: 0 in 1.082s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] <== create_volume: return (2108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:37:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb18664d-d778-4e6a-8697-7dbd2e59c6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada79e6e-dfc7-4464-8ef9-5ef792398ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:19 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Volume volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15 (7e5633a3-fb9c-42dc-9101-2aa28fed8f15): created successfully Jul 10 04:37:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada79e6e-dfc7-4464-8ef9-5ef792398ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Flow 'volume_create_manager' (f372d06c-4f1d-46c6-91ca-d124a2653112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:37:20 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-4527bc75-618a-400e-aec1-849aeff27a2e tempest-VolumesDeleteCascade-1554998591 None] Created volume successfully. Jul 10 04:37:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2aec6f5f-f87e-45a3-9a83-0874cfce306d tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2aec6f5f-f87e-45a3-9a83-0874cfce306d tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-2aec6f5f-f87e-45a3-9a83-0874cfce306d tempest-VolumesDeleteCascade-1554998591 None] Creating offline snapshot dce8cbe7-284e-40aa-bd90-842a2a2aca97 of volume 7e5633a3-fb9c-42dc-9101-2aa28fed8f15 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:37:21 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99d12fc-34a3-465b-a5a2-af3f77891020]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2aec6f5f-f87e-45a3-9a83-0874cfce306d tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:21 devstack sudo[91990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15 Jul 10 04:37:21 devstack sudo[91990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:22 devstack sudo[91990]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2aec6f5f-f87e-45a3-9a83-0874cfce306d tempest-VolumesDeleteCascade-1554998591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15" returned: 0 in 1.196s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2aec6f5f-f87e-45a3-9a83-0874cfce306d tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:22 devstack sudo[91997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97 1G Jul 10 04:37:22 devstack sudo[91997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:23 devstack sudo[91997]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2aec6f5f-f87e-45a3-9a83-0874cfce306d tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97 1G" returned: 0 in 1.088s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2aec6f5f-f87e-45a3-9a83-0874cfce306d tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:23 devstack sudo[92004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97 Jul 10 04:37:23 devstack sudo[92004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:24 devstack sudo[92004]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2aec6f5f-f87e-45a3-9a83-0874cfce306d tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97" returned: 0 in 0.817s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:24 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-2aec6f5f-f87e-45a3-9a83-0874cfce306d tempest-VolumesDeleteCascade-1554998591 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97 is being set with open permissions: ugo+rw Jul 10 04:37:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2aec6f5f-f87e-45a3-9a83-0874cfce306d tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:24 devstack sudo[92014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97 Jul 10 04:37:24 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:25 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2aec6f5f-f87e-45a3-9a83-0874cfce306d tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97" returned: 0 in 1.031s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2aec6f5f-f87e-45a3-9a83-0874cfce306d tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:25 devstack sudo[92051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.info Jul 10 04:37:25 devstack sudo[92051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:26 devstack sudo[92051]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2aec6f5f-f87e-45a3-9a83-0874cfce306d tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.info" returned: 0 in 0.882s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:26 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-2aec6f5f-f87e-45a3-9a83-0874cfce306d tempest-VolumesDeleteCascade-1554998591 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.info is being set with open permissions: ugo+rw Jul 10 04:37:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2aec6f5f-f87e-45a3-9a83-0874cfce306d tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:26 devstack sudo[92055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.info Jul 10 04:37:26 devstack sudo[92055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:27 devstack sudo[92055]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2aec6f5f-f87e-45a3-9a83-0874cfce306d tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.info" returned: 0 in 1.138s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2aec6f5f-f87e-45a3-9a83-0874cfce306d tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.372s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:27 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-2aec6f5f-f87e-45a3-9a83-0874cfce306d tempest-VolumesDeleteCascade-1554998591 None] Create snapshot completed successfully Jul 10 04:37:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5a0f7d4a-5201-41ce-aa66-5eb442918bbd tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5a0f7d4a-5201-41ce-aa66-5eb442918bbd tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-5a0f7d4a-5201-41ce-aa66-5eb442918bbd tempest-VolumesDeleteCascade-1554998591 None] Creating offline snapshot 9827675d-0a56-497d-b3f7-7dd88e4dd87a of volume 7e5633a3-fb9c-42dc-9101-2aa28fed8f15 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:37:29 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b950cb8-128a-4866-b0a2-d959b89eed2a]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5a0f7d4a-5201-41ce-aa66-5eb442918bbd tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:29 devstack sudo[92062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97 Jul 10 04:37:29 devstack sudo[92062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:30 devstack sudo[92062]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5a0f7d4a-5201-41ce-aa66-5eb442918bbd tempest-VolumesDeleteCascade-1554998591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97" returned: 0 in 0.967s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:30 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-5a0f7d4a-5201-41ce-aa66-5eb442918bbd tempest-VolumesDeleteCascade-1554998591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:37:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5a0f7d4a-5201-41ce-aa66-5eb442918bbd tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.9827675d-0a56-497d-b3f7-7dd88e4dd87a 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:30 devstack sudo[92067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.9827675d-0a56-497d-b3f7-7dd88e4dd87a 1G Jul 10 04:37:30 devstack sudo[92067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:31 devstack sudo[92067]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5a0f7d4a-5201-41ce-aa66-5eb442918bbd tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.9827675d-0a56-497d-b3f7-7dd88e4dd87a 1G" returned: 0 in 0.930s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5a0f7d4a-5201-41ce-aa66-5eb442918bbd tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.9827675d-0a56-497d-b3f7-7dd88e4dd87a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:31 devstack sudo[92072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.9827675d-0a56-497d-b3f7-7dd88e4dd87a Jul 10 04:37:31 devstack sudo[92072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:32 devstack sudo[92072]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5a0f7d4a-5201-41ce-aa66-5eb442918bbd tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.9827675d-0a56-497d-b3f7-7dd88e4dd87a" returned: 0 in 0.988s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:32 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-5a0f7d4a-5201-41ce-aa66-5eb442918bbd tempest-VolumesDeleteCascade-1554998591 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.9827675d-0a56-497d-b3f7-7dd88e4dd87a is being set with open permissions: ugo+rw Jul 10 04:37:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5a0f7d4a-5201-41ce-aa66-5eb442918bbd tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.9827675d-0a56-497d-b3f7-7dd88e4dd87a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:32 devstack sudo[92093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.9827675d-0a56-497d-b3f7-7dd88e4dd87a Jul 10 04:37:32 devstack sudo[92093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:32 devstack sudo[92093]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5a0f7d4a-5201-41ce-aa66-5eb442918bbd tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.9827675d-0a56-497d-b3f7-7dd88e4dd87a" returned: 0 in 0.867s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5a0f7d4a-5201-41ce-aa66-5eb442918bbd tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.913s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:32 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-5a0f7d4a-5201-41ce-aa66-5eb442918bbd tempest-VolumesDeleteCascade-1554998591 None] Create snapshot completed successfully Jul 10 04:37:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "cinder-7e5633a3-fb9c-42dc-9101-2aa28fed8f15-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-7e5633a3-fb9c-42dc-9101-2aa28fed8f15-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Performing cascade delete. {{(pid=87359) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 04:37:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "cinder-9827675d-0a56-497d-b3f7-7dd88e4dd87a-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-9827675d-0a56-497d-b3f7-7dd88e4dd87a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "cinder-quobyte-7e5633a3-fb9c-42dc-9101-2aa28fed8f15" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-quobyte-7e5633a3-fb9c-42dc-9101-2aa28fed8f15" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "cinder-quobyte-9827675d-0a56-497d-b3f7-7dd88e4dd87a" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-quobyte-9827675d-0a56-497d-b3f7-7dd88e4dd87a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Deleting offline snapshot 9827675d-0a56-497d-b3f7-7dd88e4dd87a of volume 7e5633a3-fb9c-42dc-9101-2aa28fed8f15 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:37:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] snapshot_file for this snap is: volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.9827675d-0a56-497d-b3f7-7dd88e4dd87a {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:37:33 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c9882a-d354-40d9-aead-2e18f6d55554]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.9827675d-0a56-497d-b3f7-7dd88e4dd87a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:33 devstack sudo[92098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.9827675d-0a56-497d-b3f7-7dd88e4dd87a Jul 10 04:37:33 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:34 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-8699f9f6-3cb5-4488-986b-e8b66e885e49 req-9705560d-a2a1-4f5f-bd17-1b8cc83b6360 tempest-AttachVolumeNegativeTest-351970016 None] Terminate volume connection completed successfully. Jul 10 04:37:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-8699f9f6-3cb5-4488-986b-e8b66e885e49 req-9705560d-a2a1-4f5f-bd17-1b8cc83b6360 tempest-AttachVolumeNegativeTest-351970016 None] Deleting attachment 796d9093-0267-4a55-a968-3d008e1c0723. {{(pid=87359) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5106}} Jul 10 04:37:34 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.9827675d-0a56-497d-b3f7-7dd88e4dd87a" returned: 0 in 0.832s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:37:34 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e35808-e709-402b-856c-1465acfaf01d]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:34 devstack sudo[92107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97 Jul 10 04:37:34 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:35 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97" returned: 0 in 0.823s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:37:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.9827675d-0a56-497d-b3f7-7dd88e4dd87a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:35 devstack sudo[92113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.9827675d-0a56-497d-b3f7-7dd88e4dd87a Jul 10 04:37:35 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:36 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.9827675d-0a56-497d-b3f7-7dd88e4dd87a" returned: 0 in 0.867s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.9827675d-0a56-497d-b3f7-7dd88e4dd87a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:36 devstack sudo[92119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.9827675d-0a56-497d-b3f7-7dd88e4dd87a Jul 10 04:37:36 devstack sudo[92119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:36 devstack sudo[92119]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.9827675d-0a56-497d-b3f7-7dd88e4dd87a" returned: 0 in 0.718s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-quobyte-9827675d-0a56-497d-b3f7-7dd88e4dd87a" released by "_delete_snapshot" :: held 3.345s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-quobyte-7e5633a3-fb9c-42dc-9101-2aa28fed8f15" released by "delete_snapshot" :: held 3.370s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:36 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Created reservations ['057db44f-999e-4870-b254-3a9e8c54c480', '754438d8-490e-476f-97bf-e71e867bcbc2', '87b40a0f-43fb-47ac-a5c3-9bb3f751606e', 'b29f45e9-aacf-4d60-a645-d73bd429bb79'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:37:36 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Delete snapshot completed successfully. Jul 10 04:37:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-9827675d-0a56-497d-b3f7-7dd88e4dd87a-delete_snapshot" released by "delete_snapshot" :: held 3.522s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "cinder-dce8cbe7-284e-40aa-bd90-842a2a2aca97-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-dce8cbe7-284e-40aa-bd90-842a2a2aca97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "cinder-quobyte-7e5633a3-fb9c-42dc-9101-2aa28fed8f15" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-quobyte-7e5633a3-fb9c-42dc-9101-2aa28fed8f15" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "cinder-quobyte-dce8cbe7-284e-40aa-bd90-842a2a2aca97" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-quobyte-dce8cbe7-284e-40aa-bd90-842a2a2aca97" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:36 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Deleting offline snapshot dce8cbe7-284e-40aa-bd90-842a2a2aca97 of volume 7e5633a3-fb9c-42dc-9101-2aa28fed8f15 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:37:36 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] snapshot_file for this snap is: volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:37:37 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b273b7-1300-42a4-8a48-7b4c7504248b]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:37 devstack sudo[92124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97 Jul 10 04:37:37 devstack sudo[92124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:37 devstack sudo[92124]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97" returned: 0 in 0.834s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:37:37 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ee5d2f-b036-4f08-8735-7b442dd09f68]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:38 devstack sudo[92136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15 Jul 10 04:37:38 devstack sudo[92136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:38 devstack sudo[92136]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15" returned: 0 in 1.109s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:39 devstack sudo[92161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97 Jul 10 04:37:39 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:40 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97" returned: 0 in 1.263s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:40 devstack sudo[92170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97 Jul 10 04:37:40 devstack sudo[92170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:40 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=56,cinder:DELETE=3,cinder:UPDATE=56,cinder:INSERT=17 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:37:40 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=73,cinder:UPDATE=63,cinder:INSERT=14,cinder:DELETE=3 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:37:40 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:37:40 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Flow 'volume_create_manager' (287194f0-1ce3-4370-9b52-4ee563d877a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:37:40 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b06b7a42-1a81-445c-8078-434e75fe4ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:40 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b06b7a42-1a81-445c-8078-434e75fe4ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-19449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e433379d-198a-49fb-bffa-407800e14231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2c3be42e7347fe961959c0b5e48ed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:37:41Z,use_quota=True,user_id='221ce63eace142b0ba0010f54eb65485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2fb9b2-bdd0-4743-851b-51eac9a03e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2fb9b2-bdd0-4743-851b-51eac9a03e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035e16cd-15c3-4765-ba74-6808d657b98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035e16cd-15c3-4765-ba74-6808d657b98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e433379d-198a-49fb-bffa-407800e14231', 'volume_name': 'volume-e433379d-198a-49fb-bffa-407800e14231', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5f90ab-1041-45a5-8194-152c37cb3755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5f90ab-1041-45a5-8194-152c37cb3755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67ca0fa1-cfaa-4ad8-a10c-483719a63995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:41 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Volume e433379d-198a-49fb-bffa-407800e14231: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e433379d-198a-49fb-bffa-407800e14231', 'volume_size': 1} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-19449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e433379d-198a-49fb-bffa-407800e14231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2c3be42e7347fe961959c0b5e48ed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:37:41Z,use_quota=True,user_id='221ce63eace142b0ba0010f54eb65485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Creating volume e433379d-198a-49fb-bffa-407800e14231 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:37:41 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e433379d-198a-49fb-bffa-407800e14231 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:41 devstack sudo[92174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e433379d-198a-49fb-bffa-407800e14231 1073741824 Jul 10 04:37:41 devstack sudo[92170]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:41 devstack sudo[92174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15.dce8cbe7-284e-40aa-bd90-842a2a2aca97" returned: 0 in 0.817s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-quobyte-dce8cbe7-284e-40aa-bd90-842a2a2aca97" released by "_delete_snapshot" :: held 4.148s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-quobyte-7e5633a3-fb9c-42dc-9101-2aa28fed8f15" released by "delete_snapshot" :: held 4.174s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Created reservations ['d8f8fa22-5b2d-4a95-8aa1-255fd3a47d2e', '1a8c9e1f-b9ba-48cd-8321-f0e4f79d5db8', 'aadb6352-b93e-4876-a20a-01355ed0ddd0', '978d45da-ec4e-49e9-8413-6e7d98c73a0b'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:37:41 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Delete snapshot completed successfully. Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-dce8cbe7-284e-40aa-bd90-842a2a2aca97-delete_snapshot" released by "delete_snapshot" :: held 4.355s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Snapshots deleted, issuing volume delete {{(pid=87359) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "cinder-quobyte-7e5633a3-fb9c-42dc-9101-2aa28fed8f15" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-quobyte-7e5633a3-fb9c-42dc-9101-2aa28fed8f15" acquired by "delete_volume" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[de26324e-e71b-4ebc-955c-8bd6f638e829]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:41 devstack sudo[92176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15 Jul 10 04:37:41 devstack sudo[92176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:42 devstack sudo[92174]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e433379d-198a-49fb-bffa-407800e14231 1073741824" returned: 0 in 1.040s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e433379d-198a-49fb-bffa-407800e14231 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:42 devstack sudo[92187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e433379d-198a-49fb-bffa-407800e14231 Jul 10 04:37:42 devstack sudo[92187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:42 devstack sudo[92176]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15" returned: 0 in 0.855s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:42 devstack sudo[92189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15 Jul 10 04:37:42 devstack sudo[92189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:42 devstack sudo[92187]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e433379d-198a-49fb-bffa-407800e14231" returned: 0 in 0.673s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:37:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67ca0fa1-cfaa-4ad8-a10c-483719a63995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e433379d-198a-49fb-bffa-407800e14231', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a6a5a3c-4b22-48db-9ab3-866de6f33656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:42 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Volume volume-e433379d-198a-49fb-bffa-407800e14231 (e433379d-198a-49fb-bffa-407800e14231): created successfully Jul 10 04:37:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a6a5a3c-4b22-48db-9ab3-866de6f33656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Flow 'volume_create_manager' (287194f0-1ce3-4370-9b52-4ee563d877a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:37:42 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-0b56697d-8768-4089-9374-e913caf72879 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Created volume successfully. Jul 10 04:37:42 devstack sudo[92189]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7e5633a3-fb9c-42dc-9101-2aa28fed8f15" returned: 0 in 0.700s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-quobyte-7e5633a3-fb9c-42dc-9101-2aa28fed8f15" released by "delete_volume" :: held 1.619s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:42 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Created reservations ['0eeed730-39ae-42fd-84f4-704261a8258f', 'dd9ee390-6afd-4907-8fae-9fb74dc0eae6', 'cef8a5fd-61fc-41c5-99cc-f7dff5933639', '400fb306-febe-48d5-ac4f-c63b741ad970'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:37:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:43 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:37:43 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:37:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:43 devstack sudo[92194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:37:43 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:43 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9eef5637-da02-4b56-a19e-4f52a1d633b8 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Acquiring lock "cinder-e433379d-198a-49fb-bffa-407800e14231-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:43 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9eef5637-da02-4b56-a19e-4f52a1d633b8 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Lock "cinder-e433379d-198a-49fb-bffa-407800e14231-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:43 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9eef5637-da02-4b56-a19e-4f52a1d633b8 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Acquiring lock "cinder-quobyte-e433379d-198a-49fb-bffa-407800e14231" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:43 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9eef5637-da02-4b56-a19e-4f52a1d633b8 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Lock "cinder-quobyte-e433379d-198a-49fb-bffa-407800e14231" acquired by "delete_volume" :: waited 0.027s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:43 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[0339ce03-c18e-4bc5-8f5f-e46e4432acba]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9eef5637-da02-4b56-a19e-4f52a1d633b8 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e433379d-198a-49fb-bffa-407800e14231 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:43 devstack sudo[92196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e433379d-198a-49fb-bffa-407800e14231 Jul 10 04:37:43 devstack sudo[92196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:43 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-4751ae78-1761-47ef-a79e-d514dd28eef0 req-6b261c4a-ec1a-4d35-93be-fd1c066f450b tempest-ServerActionsTestOtherA-972236372 None] Terminate volume connection completed successfully. Jul 10 04:37:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-4751ae78-1761-47ef-a79e-d514dd28eef0 req-6b261c4a-ec1a-4d35-93be-fd1c066f450b tempest-ServerActionsTestOtherA-972236372 None] Deleting attachment dd34170e-b025-4a07-b55c-2ebf107dfe44. {{(pid=87359) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5106}} Jul 10 04:37:43 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:37:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Flow 'volume_create_manager' (71d7ddf6-a8a3-4887-8271-8b2870adca10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:37:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7226a75b-d39f-4d2b-9f0a-b65d0fb73a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7226a75b-d39f-4d2b-9f0a-b65d0fb73a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1891767827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d032a2d9-e084-4eee-9dd3-b5e7f170d2ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40208ef754474941956120c713c22bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:37:44Z,use_quota=True,user_id='fa39c3c7f33b4e06b5be62645a055f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:43 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553ee1de-93a6-4c49-92e0-85dcc760eaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553ee1de-93a6-4c49-92e0-85dcc760eaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9689b6f2-33a5-483a-8057-62956655f540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9689b6f2-33a5-483a-8057-62956655f540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd032a2d9-e084-4eee-9dd3-b5e7f170d2ee', 'volume_name': 'volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f62b35-3a80-4c09-8dbc-356ba540603f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:44 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f62b35-3a80-4c09-8dbc-356ba540603f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:44 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611ca0df-5c2e-4802-af8d-00d5c7ed8927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:44 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Volume d032a2d9-e084-4eee-9dd3-b5e7f170d2ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee', 'volume_size': 1} Jul 10 04:37:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1891767827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d032a2d9-e084-4eee-9dd3-b5e7f170d2ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40208ef754474941956120c713c22bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:37:44Z,use_quota=True,user_id='fa39c3c7f33b4e06b5be62645a055f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:37:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Creating volume d032a2d9-e084-4eee-9dd3-b5e7f170d2ee {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:37:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:37:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:37:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:37:44 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:37:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.947s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:44 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:37:44 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Deleted volume successfully. Jul 10 04:37:44 devstack sudo[92202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee 1073741824 Jul 10 04:37:44 devstack sudo[92202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:44 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cad925f-a124-41e7-bf60-7b9693678724 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-7e5633a3-fb9c-42dc-9101-2aa28fed8f15-delete_volume" released by "delete_volume" :: held 10.762s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:44 devstack sudo[92196]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9eef5637-da02-4b56-a19e-4f52a1d633b8 tempest-VolumeQuotasAdminTestJSON-1888137088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e433379d-198a-49fb-bffa-407800e14231" returned: 0 in 1.028s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9eef5637-da02-4b56-a19e-4f52a1d633b8 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e433379d-198a-49fb-bffa-407800e14231 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:44 devstack sudo[92207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e433379d-198a-49fb-bffa-407800e14231 Jul 10 04:37:44 devstack sudo[92207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:45 devstack sudo[92202]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee 1073741824" returned: 0 in 0.997s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:45 devstack sudo[92214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee Jul 10 04:37:45 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:45 devstack sudo[92207]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9eef5637-da02-4b56-a19e-4f52a1d633b8 tempest-VolumeQuotasAdminTestJSON-1888137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e433379d-198a-49fb-bffa-407800e14231" returned: 0 in 0.806s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:45 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9eef5637-da02-4b56-a19e-4f52a1d633b8 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Lock "cinder-quobyte-e433379d-198a-49fb-bffa-407800e14231" released by "delete_volume" :: held 1.873s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:45 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-9eef5637-da02-4b56-a19e-4f52a1d633b8 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Created reservations ['23ffb250-73f0-4a47-a860-bf8ca5f13ac9', 'e6e41c6a-677c-4950-9914-e44c7646711b', 'f5307580-9ea7-4050-bc9c-c2505828ce02', 'd0919be3-1518-4935-a456-8eb2d952a4be'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:37:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9eef5637-da02-4b56-a19e-4f52a1d633b8 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9eef5637-da02-4b56-a19e-4f52a1d633b8 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:45 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9eef5637-da02-4b56-a19e-4f52a1d633b8 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:37:45 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9eef5637-da02-4b56-a19e-4f52a1d633b8 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:37:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9eef5637-da02-4b56-a19e-4f52a1d633b8 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9eef5637-da02-4b56-a19e-4f52a1d633b8 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:45 devstack sudo[92216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:37:45 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:45 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee" returned: 0 in 0.919s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:45 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:37:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611ca0df-5c2e-4802-af8d-00d5c7ed8927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3d5ffb-799b-4020-8c77-f241e7192961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:46 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Volume volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee (d032a2d9-e084-4eee-9dd3-b5e7f170d2ee): created successfully Jul 10 04:37:46 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3d5ffb-799b-4020-8c77-f241e7192961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Flow 'volume_create_manager' (71d7ddf6-a8a3-4887-8271-8b2870adca10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9eef5637-da02-4b56-a19e-4f52a1d633b8 tempest-VolumeQuotasAdminTestJSON-1888137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.840s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-9eef5637-da02-4b56-a19e-4f52a1d633b8 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:37:46 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-9eef5637-da02-4b56-a19e-4f52a1d633b8 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Deleted volume successfully. Jul 10 04:37:46 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-14365386-856a-44c6-a72e-8e9a2ecf1608 tempest-VolumesDeleteCascade-1554998591 None] Created volume successfully. Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9eef5637-da02-4b56-a19e-4f52a1d633b8 tempest-VolumeQuotasAdminTestJSON-1888137088 None] Lock "cinder-e433379d-198a-49fb-bffa-407800e14231-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Flow 'volume_create_manager' (9b0a4a7e-e8aa-49b5-8daf-5e5351fa0766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b40e52-c4ab-42d8-b73b-c06c0a88bdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b40e52-c4ab-42d8-b73b-c06c0a88bdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1495981092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6f7a18-3184-413c-9320-da2a0fd74e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2c3be42e7347fe961959c0b5e48ed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:37:46Z,use_quota=True,user_id='221ce63eace142b0ba0010f54eb65485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187ce12a-e12b-4bf5-bf17-4b138b12fc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187ce12a-e12b-4bf5-bf17-4b138b12fc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcad8efa-ef96-4274-be4d-e9e31c4413ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcad8efa-ef96-4274-be4d-e9e31c4413ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e6f7a18-3184-413c-9320-da2a0fd74e72', 'volume_name': 'volume-8e6f7a18-3184-413c-9320-da2a0fd74e72', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6999f875-c081-42a7-81a6-f3f6ba9f9ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6999f875-c081-42a7-81a6-f3f6ba9f9ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdda8195-5440-45b3-a9ef-63a908b23a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:46 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Volume 8e6f7a18-3184-413c-9320-da2a0fd74e72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e6f7a18-3184-413c-9320-da2a0fd74e72', 'volume_size': 1} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1495981092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6f7a18-3184-413c-9320-da2a0fd74e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2c3be42e7347fe961959c0b5e48ed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:37:46Z,use_quota=True,user_id='221ce63eace142b0ba0010f54eb65485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Creating volume 8e6f7a18-3184-413c-9320-da2a0fd74e72 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:37:46 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:37:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e6f7a18-3184-413c-9320-da2a0fd74e72 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:46 devstack sudo[92221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e6f7a18-3184-413c-9320-da2a0fd74e72 1073741824 Jul 10 04:37:46 devstack sudo[92221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ee1040c3-c4c9-4291-9a60-6048d0a1886a tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:47 devstack sudo[92221]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e6f7a18-3184-413c-9320-da2a0fd74e72 1073741824" returned: 0 in 1.014s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e6f7a18-3184-413c-9320-da2a0fd74e72 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:47 devstack sudo[92227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e6f7a18-3184-413c-9320-da2a0fd74e72 Jul 10 04:37:47 devstack sudo[92227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:48 devstack sudo[92227]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e6f7a18-3184-413c-9320-da2a0fd74e72" returned: 0 in 0.857s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:37:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ee1040c3-c4c9-4291-9a60-6048d0a1886a tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.976s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdda8195-5440-45b3-a9ef-63a908b23a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e6f7a18-3184-413c-9320-da2a0fd74e72', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00e5b5e-068e-44b3-9ece-347d620a8f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-ee1040c3-c4c9-4291-9a60-6048d0a1886a tempest-VolumesDeleteCascade-1554998591 None] Creating offline snapshot 5750b4fe-dd78-4f51-b75a-fde118b800da of volume d032a2d9-e084-4eee-9dd3-b5e7f170d2ee {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:37:48 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Volume volume-8e6f7a18-3184-413c-9320-da2a0fd74e72 (8e6f7a18-3184-413c-9320-da2a0fd74e72): created successfully Jul 10 04:37:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00e5b5e-068e-44b3-9ece-347d620a8f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Flow 'volume_create_manager' (9b0a4a7e-e8aa-49b5-8daf-5e5351fa0766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:37:48 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eac7e9a-b912-4892-b48f-e8f4d87a2e69]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee1040c3-c4c9-4291-9a60-6048d0a1886a tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:48 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-44abb813-fd6a-4167-8c42-05fca8e8fd6c tempest-VolumeQuotasAdminTestJSON-1888137088 None] Created volume successfully. Jul 10 04:37:48 devstack sudo[92251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee Jul 10 04:37:48 devstack sudo[92251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:49 devstack sudo[92251]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee1040c3-c4c9-4291-9a60-6048d0a1886a tempest-VolumesDeleteCascade-1554998591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee" returned: 0 in 1.055s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee1040c3-c4c9-4291-9a60-6048d0a1886a tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:49 devstack sudo[92266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da 1G Jul 10 04:37:49 devstack sudo[92266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:50 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-25455078-631d-4951-8ca4-20979faf61f3 tempest-VolumeQuotasAdminTestJSON-1835798005 None] Transfer volume completed successfully. Jul 10 04:37:50 devstack sudo[92266]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee1040c3-c4c9-4291-9a60-6048d0a1886a tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da 1G" returned: 0 in 0.962s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee1040c3-c4c9-4291-9a60-6048d0a1886a tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:50 devstack sudo[92276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da Jul 10 04:37:50 devstack sudo[92276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:51 devstack sudo[92276]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee1040c3-c4c9-4291-9a60-6048d0a1886a tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da" returned: 0 in 0.686s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:51 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-ee1040c3-c4c9-4291-9a60-6048d0a1886a tempest-VolumesDeleteCascade-1554998591 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da is being set with open permissions: ugo+rw Jul 10 04:37:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee1040c3-c4c9-4291-9a60-6048d0a1886a tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:51 devstack sudo[92283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da Jul 10 04:37:51 devstack sudo[92283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c158574-d9e4-4948-94a3-374ecedecc94 tempest-VolumeQuotasAdminTestJSON-1473605627 None] Acquiring lock "cinder-8e6f7a18-3184-413c-9320-da2a0fd74e72-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c158574-d9e4-4948-94a3-374ecedecc94 tempest-VolumeQuotasAdminTestJSON-1473605627 None] Lock "cinder-8e6f7a18-3184-413c-9320-da2a0fd74e72-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c158574-d9e4-4948-94a3-374ecedecc94 tempest-VolumeQuotasAdminTestJSON-1473605627 None] Acquiring lock "cinder-quobyte-8e6f7a18-3184-413c-9320-da2a0fd74e72" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c158574-d9e4-4948-94a3-374ecedecc94 tempest-VolumeQuotasAdminTestJSON-1473605627 None] Lock "cinder-quobyte-8e6f7a18-3184-413c-9320-da2a0fd74e72" acquired by "delete_volume" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:51 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9b5204-eb07-46d1-b390-2d335dbcbcb3]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c158574-d9e4-4948-94a3-374ecedecc94 tempest-VolumeQuotasAdminTestJSON-1473605627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e6f7a18-3184-413c-9320-da2a0fd74e72 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:51 devstack sudo[92285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e6f7a18-3184-413c-9320-da2a0fd74e72 Jul 10 04:37:51 devstack sudo[92285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:51 devstack sudo[92283]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee1040c3-c4c9-4291-9a60-6048d0a1886a tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da" returned: 0 in 0.656s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee1040c3-c4c9-4291-9a60-6048d0a1886a tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:51 devstack sudo[92288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.info Jul 10 04:37:51 devstack sudo[92288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:52 devstack sudo[92285]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c158574-d9e4-4948-94a3-374ecedecc94 tempest-VolumeQuotasAdminTestJSON-1473605627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e6f7a18-3184-413c-9320-da2a0fd74e72" returned: 0 in 0.795s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c158574-d9e4-4948-94a3-374ecedecc94 tempest-VolumeQuotasAdminTestJSON-1473605627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e6f7a18-3184-413c-9320-da2a0fd74e72 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:52 devstack sudo[92293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e6f7a18-3184-413c-9320-da2a0fd74e72 Jul 10 04:37:52 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:52 devstack sudo[92288]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee1040c3-c4c9-4291-9a60-6048d0a1886a tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.info" returned: 0 in 0.679s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:52 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-ee1040c3-c4c9-4291-9a60-6048d0a1886a tempest-VolumesDeleteCascade-1554998591 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.info is being set with open permissions: ugo+rw Jul 10 04:37:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee1040c3-c4c9-4291-9a60-6048d0a1886a tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:52 devstack sudo[92296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.info Jul 10 04:37:52 devstack sudo[92296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:52 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c158574-d9e4-4948-94a3-374ecedecc94 tempest-VolumeQuotasAdminTestJSON-1473605627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e6f7a18-3184-413c-9320-da2a0fd74e72" returned: 0 in 0.752s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c158574-d9e4-4948-94a3-374ecedecc94 tempest-VolumeQuotasAdminTestJSON-1473605627 None] Lock "cinder-quobyte-8e6f7a18-3184-413c-9320-da2a0fd74e72" released by "delete_volume" :: held 1.608s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:53 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-9c158574-d9e4-4948-94a3-374ecedecc94 tempest-VolumeQuotasAdminTestJSON-1473605627 None] Created reservations ['6a86d8e7-aaa7-4f23-b09c-d7f8e2fb7dd1', '76a4b158-9b40-4440-a2eb-8ebe1169f887', '6c731699-510c-43c0-ac37-d5e863021eee', '23397d69-c8de-4cab-a682-b46458b87ead'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:37:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9c158574-d9e4-4948-94a3-374ecedecc94 tempest-VolumeQuotasAdminTestJSON-1473605627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9c158574-d9e4-4948-94a3-374ecedecc94 tempest-VolumeQuotasAdminTestJSON-1473605627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:53 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9c158574-d9e4-4948-94a3-374ecedecc94 tempest-VolumeQuotasAdminTestJSON-1473605627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:37:53 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9c158574-d9e4-4948-94a3-374ecedecc94 tempest-VolumeQuotasAdminTestJSON-1473605627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:37:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9c158574-d9e4-4948-94a3-374ecedecc94 tempest-VolumeQuotasAdminTestJSON-1473605627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c158574-d9e4-4948-94a3-374ecedecc94 tempest-VolumeQuotasAdminTestJSON-1473605627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:53 devstack sudo[92300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:37:53 devstack sudo[92300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:53 devstack sudo[92296]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee1040c3-c4c9-4291-9a60-6048d0a1886a tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.info" returned: 0 in 0.696s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ee1040c3-c4c9-4291-9a60-6048d0a1886a tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.879s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:53 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ee1040c3-c4c9-4291-9a60-6048d0a1886a tempest-VolumesDeleteCascade-1554998591 None] Create snapshot completed successfully Jul 10 04:37:53 devstack sudo[92300]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c158574-d9e4-4948-94a3-374ecedecc94 tempest-VolumeQuotasAdminTestJSON-1473605627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.827s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:53 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-9c158574-d9e4-4948-94a3-374ecedecc94 tempest-VolumeQuotasAdminTestJSON-1473605627 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:37:53 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-9c158574-d9e4-4948-94a3-374ecedecc94 tempest-VolumeQuotasAdminTestJSON-1473605627 None] Deleted volume successfully. Jul 10 04:37:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c158574-d9e4-4948-94a3-374ecedecc94 tempest-VolumeQuotasAdminTestJSON-1473605627 None] Lock "cinder-8e6f7a18-3184-413c-9320-da2a0fd74e72-delete_volume" released by "delete_volume" :: held 2.674s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Flow 'volume_create_manager' (5686ec67-e090-44db-9435-cb7665dd78f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f3db5c-52f3-482d-8b43-029fdb0946c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f3db5c-52f3-482d-8b43-029fdb0946c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-62202939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6846df-8f41-409b-9fa7-0db77f899dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40208ef754474941956120c713c22bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5750b4fe-dd78-4f51-b75a-fde118b800da,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:37:54Z,use_quota=True,user_id='fa39c3c7f33b4e06b5be62645a055f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7688e319-e45f-474e-9e0a-839dbae9b640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7688e319-e45f-474e-9e0a-839dbae9b640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1130749b-0b27-48f8-ad94-edccd4230464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1130749b-0b27-48f8-ad94-edccd4230464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0b6846df-8f41-409b-9fa7-0db77f899dc3', 'volume_name': 'volume-0b6846df-8f41-409b-9fa7-0db77f899dc3', 'volume_size': 1, 'snapshot_id': '5750b4fe-dd78-4f51-b75a-fde118b800da'}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd8bd72-0d66-4deb-b9e2-a57b6b437f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd8bd72-0d66-4deb-b9e2-a57b6b437f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85196fc-77fb-49e5-ae91-68b1a2d608da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:54 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Volume 0b6846df-8f41-409b-9fa7-0db77f899dc3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0b6846df-8f41-409b-9fa7-0db77f899dc3', 'volume_size': 1, 'snapshot_id': '5750b4fe-dd78-4f51-b75a-fde118b800da'} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "cinder-quobyte-5750b4fe-dd78-4f51-b75a-fde118b800da-0b6846df-8f41-409b-9fa7-0db77f899dc3" by "_create_volume_from_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-quobyte-5750b4fe-dd78-4f51-b75a-fde118b800da-0b6846df-8f41-409b-9fa7-0db77f899dc3" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Creating volume 0b6846df-8f41-409b-9fa7-0db77f899dc3 from snapshot 5750b4fe-dd78-4f51-b75a-fde118b800da {{(pid=87359) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "cinder-quobyte-0b6846df-8f41-409b-9fa7-0db77f899dc3" by "_copy_volume_from_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-quobyte-0b6846df-8f41-409b-9fa7-0db77f899dc3" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] snapshot: 5750b4fe-dd78-4f51-b75a-fde118b800da, volume: 0b6846df-8f41-409b-9fa7-0db77f899dc3, {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4d59b3-2097-4f6c-87d4-4d4589c1ddc7]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:54 devstack sudo[92303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da Jul 10 04:37:54 devstack sudo[92303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:55 devstack sudo[92303]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da" returned: 0 in 1.136s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:37:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 04:37:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Creating direct copy from snapshot {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 04:37:55 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4a4fa2-9d08-439e-a0fe-cb68345dc7ce]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:56 devstack sudo[92320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee Jul 10 04:37:56 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:56 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee" returned: 0 in 0.963s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:56 devstack cinder-volume[87359]: DEBUG cinder.utils [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Path /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0b6846df-8f41-409b-9fa7-0db77f899dc3 not found in is_blk_device check {{(pid=87359) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 04:37:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0b6846df-8f41-409b-9fa7-0db77f899dc3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5a0bf86a-6699-4d76-9610-e1f416a2b46e tempest-ServerActionsTestOtherA-972236372 None] Acquiring lock "cinder-55422687-5c0c-418d-8504-d14f31894931-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:56 devstack sudo[92368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0b6846df-8f41-409b-9fa7-0db77f899dc3 Jul 10 04:37:56 devstack sudo[92368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5a0bf86a-6699-4d76-9610-e1f416a2b46e tempest-ServerActionsTestOtherA-972236372 None] Lock "cinder-55422687-5c0c-418d-8504-d14f31894931-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5a0bf86a-6699-4d76-9610-e1f416a2b46e tempest-ServerActionsTestOtherA-972236372 None] Acquiring lock "cinder-quobyte-55422687-5c0c-418d-8504-d14f31894931" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5a0bf86a-6699-4d76-9610-e1f416a2b46e tempest-ServerActionsTestOtherA-972236372 None] Lock "cinder-quobyte-55422687-5c0c-418d-8504-d14f31894931" acquired by "delete_volume" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:57 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae705956-ccbc-4296-88ab-f908a5afc103]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5a0bf86a-6699-4d76-9610-e1f416a2b46e tempest-ServerActionsTestOtherA-972236372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55422687-5c0c-418d-8504-d14f31894931 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:57 devstack sudo[92372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55422687-5c0c-418d-8504-d14f31894931 Jul 10 04:37:57 devstack sudo[92372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:58 devstack sudo[92372]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5a0bf86a-6699-4d76-9610-e1f416a2b46e tempest-ServerActionsTestOtherA-972236372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55422687-5c0c-418d-8504-d14f31894931" returned: 0 in 1.191s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5a0bf86a-6699-4d76-9610-e1f416a2b46e tempest-ServerActionsTestOtherA-972236372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55422687-5c0c-418d-8504-d14f31894931 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:58 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55422687-5c0c-418d-8504-d14f31894931 Jul 10 04:37:58 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:00 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5a0bf86a-6699-4d76-9610-e1f416a2b46e tempest-ServerActionsTestOtherA-972236372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55422687-5c0c-418d-8504-d14f31894931" returned: 0 in 2.473s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:00 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5a0bf86a-6699-4d76-9610-e1f416a2b46e tempest-ServerActionsTestOtherA-972236372 None] Lock "cinder-quobyte-55422687-5c0c-418d-8504-d14f31894931" released by "delete_volume" :: held 3.769s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:01 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-5a0bf86a-6699-4d76-9610-e1f416a2b46e tempest-ServerActionsTestOtherA-972236372 None] Created reservations ['5c819085-b23a-4380-85c6-e9ab65d6e173', 'd0ef483a-3604-40aa-b5b1-c1afa1ce7646', '05ca9ad0-5195-4213-b062-5c5965533a44', '26129103-2976-4645-9eed-ef613e7a12d9'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:38:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5a0bf86a-6699-4d76-9610-e1f416a2b46e tempest-ServerActionsTestOtherA-972236372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5a0bf86a-6699-4d76-9610-e1f416a2b46e tempest-ServerActionsTestOtherA-972236372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5a0bf86a-6699-4d76-9610-e1f416a2b46e tempest-ServerActionsTestOtherA-972236372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5a0bf86a-6699-4d76-9610-e1f416a2b46e tempest-ServerActionsTestOtherA-972236372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5a0bf86a-6699-4d76-9610-e1f416a2b46e tempest-ServerActionsTestOtherA-972236372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5a0bf86a-6699-4d76-9610-e1f416a2b46e tempest-ServerActionsTestOtherA-972236372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:01 devstack sudo[92393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:38:01 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:03 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5a0bf86a-6699-4d76-9610-e1f416a2b46e tempest-ServerActionsTestOtherA-972236372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.734s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:03 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-5a0bf86a-6699-4d76-9610-e1f416a2b46e tempest-ServerActionsTestOtherA-972236372 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:38:03 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-5a0bf86a-6699-4d76-9610-e1f416a2b46e tempest-ServerActionsTestOtherA-972236372 None] Deleted volume successfully. Jul 10 04:38:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5a0bf86a-6699-4d76-9610-e1f416a2b46e tempest-ServerActionsTestOtherA-972236372 None] Lock "cinder-55422687-5c0c-418d-8504-d14f31894931-delete_volume" released by "delete_volume" :: held 6.233s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:04 devstack sudo[92368]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0b6846df-8f41-409b-9fa7-0db77f899dc3" returned: 0 in 7.460s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:04 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8571ff7-86a2-4fd2-91a5-86cd27711a2e]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:04 devstack sudo[92473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee Jul 10 04:38:04 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:06 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee" returned: 0 in 1.850s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:06 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee, size 1024.00 MB, duration 7.46 sec, destination /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0b6846df-8f41-409b-9fa7-0db77f899dc3 {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:38:06 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Converted 1024.00 MB image at 137.24 MB/s Jul 10 04:38:06 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0b6846df-8f41-409b-9fa7-0db77f899dc3 is being set with open permissions: ugo+rw Jul 10 04:38:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0b6846df-8f41-409b-9fa7-0db77f899dc3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:06 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0b6846df-8f41-409b-9fa7-0db77f899dc3 Jul 10 04:38:06 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:07 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0b6846df-8f41-409b-9fa7-0db77f899dc3" returned: 0 in 1.287s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:07 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-quobyte-0b6846df-8f41-409b-9fa7-0db77f899dc3" released by "_copy_volume_from_snapshot" :: held 12.859s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:07 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-quobyte-5750b4fe-dd78-4f51-b75a-fde118b800da-0b6846df-8f41-409b-9fa7-0db77f899dc3" released by "_create_volume_from_snapshot" :: held 12.909s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.941s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85196fc-77fb-49e5-ae91-68b1a2d608da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b6846df-8f41-409b-9fa7-0db77f899dc3', 'volume_size': 1, 'snapshot_id': '5750b4fe-dd78-4f51-b75a-fde118b800da'}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb540f3-5398-4827-b052-e627f315984f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:07 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Volume volume-0b6846df-8f41-409b-9fa7-0db77f899dc3 (0b6846df-8f41-409b-9fa7-0db77f899dc3): created successfully Jul 10 04:38:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb540f3-5398-4827-b052-e627f315984f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Flow 'volume_create_manager' (5686ec67-e090-44db-9435-cb7665dd78f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:07 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-66d4efb0-4706-46af-a010-b9204ee79e1a tempest-VolumesDeleteCascade-1554998591 None] Created volume successfully. Jul 10 04:38:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "cinder-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Performing cascade delete. {{(pid=87359) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 04:38:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "cinder-5750b4fe-dd78-4f51-b75a-fde118b800da-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-5750b4fe-dd78-4f51-b75a-fde118b800da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "cinder-quobyte-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-quobyte-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "cinder-quobyte-5750b4fe-dd78-4f51-b75a-fde118b800da" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-quobyte-5750b4fe-dd78-4f51-b75a-fde118b800da" acquired by "_delete_snapshot" :: waited 0.064s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Deleting offline snapshot 5750b4fe-dd78-4f51-b75a-fde118b800da of volume d032a2d9-e084-4eee-9dd3-b5e7f170d2ee {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:38:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] snapshot_file for this snap is: volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:38:08 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[765fa47d-94d7-45ae-b1da-04050fa38544]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:08 devstack sudo[92508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da Jul 10 04:38:08 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Flow 'volume_create_manager' (d61b38f6-4567-41f9-b2a9-007ef8144cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9253b7c-424e-43a6-acec-410e8565c25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9253b7c-424e-43a6-acec-410e8565c25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1289858525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c27de1-6b67-4b26-a875-5dca2d21cdc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c070c48a71d747b4b87db9249c95c71c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:09Z,use_quota=True,user_id='f317fea5c75a415eae872f5a5fb09229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6249b4-b530-48f2-95f0-a0c247f580cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6249b4-b530-48f2-95f0-a0c247f580cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637f5f27-b485-48e7-8d2c-03afaf162bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637f5f27-b485-48e7-8d2c-03afaf162bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24c27de1-6b67-4b26-a875-5dca2d21cdc1', 'volume_name': 'volume-24c27de1-6b67-4b26-a875-5dca2d21cdc1', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c028d578-a22f-47ce-a3c3-9d5b43224eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c028d578-a22f-47ce-a3c3-9d5b43224eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4132d4a7-99f0-4fdb-b4dc-247d684f7c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:09 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Volume 24c27de1-6b67-4b26-a875-5dca2d21cdc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24c27de1-6b67-4b26-a875-5dca2d21cdc1', 'volume_size': 1} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1289858525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c27de1-6b67-4b26-a875-5dca2d21cdc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c070c48a71d747b4b87db9249c95c71c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:09Z,use_quota=True,user_id='f317fea5c75a415eae872f5a5fb09229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Creating volume 24c27de1-6b67-4b26-a875-5dca2d21cdc1 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:38:09 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c27de1-6b67-4b26-a875-5dca2d21cdc1 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:09 devstack sudo[92512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c27de1-6b67-4b26-a875-5dca2d21cdc1 1073741824 Jul 10 04:38:09 devstack sudo[92512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:09 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da" returned: 0 in 0.998s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c28fbd7-dd3b-4cfe-bc75-e9b774b50769]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:09 devstack sudo[92518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee Jul 10 04:38:09 devstack sudo[92518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:10 devstack sudo[92512]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c27de1-6b67-4b26-a875-5dca2d21cdc1 1073741824" returned: 0 in 0.928s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c27de1-6b67-4b26-a875-5dca2d21cdc1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:10 devstack sudo[92530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c27de1-6b67-4b26-a875-5dca2d21cdc1 Jul 10 04:38:10 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:10 devstack sudo[92518]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee" returned: 0 in 0.984s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:10 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da Jul 10 04:38:10 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:11 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c27de1-6b67-4b26-a875-5dca2d21cdc1" returned: 0 in 0.934s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:11 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:38:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4132d4a7-99f0-4fdb-b4dc-247d684f7c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24c27de1-6b67-4b26-a875-5dca2d21cdc1', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf269a7-abcc-4fc9-89f4-46501e943264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:11 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Volume volume-24c27de1-6b67-4b26-a875-5dca2d21cdc1 (24c27de1-6b67-4b26-a875-5dca2d21cdc1): created successfully Jul 10 04:38:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf269a7-abcc-4fc9-89f4-46501e943264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Flow 'volume_create_manager' (d61b38f6-4567-41f9-b2a9-007ef8144cd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:11 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c31476e9-2db9-433a-a451-9256cd5663e2 tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Created volume successfully. Jul 10 04:38:11 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da" returned: 0 in 0.898s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:11 devstack sudo[92541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da Jul 10 04:38:11 devstack sudo[92541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:12 devstack sudo[92541]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee.5750b4fe-dd78-4f51-b75a-fde118b800da" returned: 0 in 0.764s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:12 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-quobyte-5750b4fe-dd78-4f51-b75a-fde118b800da" released by "_delete_snapshot" :: held 3.782s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:12 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-quobyte-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee" released by "delete_snapshot" :: held 3.861s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:12 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Created reservations ['ed5fee60-f4a8-47ce-bdcf-825013869275', 'd88d1d48-3919-47e7-85e2-c38d393c16c4', 'e218eafe-eeb4-45d1-ad91-77e7a2d98d6e', 'aea825b5-69e7-4519-9725-082d2715ca38'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:38:12 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Delete snapshot completed successfully. Jul 10 04:38:12 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-5750b4fe-dd78-4f51-b75a-fde118b800da-delete_snapshot" released by "delete_snapshot" :: held 4.167s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Snapshots deleted, issuing volume delete {{(pid=87359) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 04:38:12 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "cinder-quobyte-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:12 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-quobyte-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee" acquired by "delete_volume" :: waited 0.027s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:12 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b80fdc-a1ea-43c5-8dd5-d6dd77cdba9c]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:12 devstack sudo[92545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee Jul 10 04:38:12 devstack sudo[92545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-53cad194-2bf8-4715-a565-32ca45e967df tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Acquiring lock "cinder-24c27de1-6b67-4b26-a875-5dca2d21cdc1-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-53cad194-2bf8-4715-a565-32ca45e967df tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Lock "cinder-24c27de1-6b67-4b26-a875-5dca2d21cdc1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-53cad194-2bf8-4715-a565-32ca45e967df tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Acquiring lock "cinder-quobyte-24c27de1-6b67-4b26-a875-5dca2d21cdc1" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-53cad194-2bf8-4715-a565-32ca45e967df tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Lock "cinder-quobyte-24c27de1-6b67-4b26-a875-5dca2d21cdc1" acquired by "delete_volume" :: waited 0.030s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:13 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ea8355-1ef8-4502-ba81-d902bd6ea6c4]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-53cad194-2bf8-4715-a565-32ca45e967df tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c27de1-6b67-4b26-a875-5dca2d21cdc1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:13 devstack sudo[92545]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee" returned: 0 in 1.197s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:13 devstack sudo[92552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c27de1-6b67-4b26-a875-5dca2d21cdc1 Jul 10 04:38:13 devstack sudo[92552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:13 devstack sudo[92554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee Jul 10 04:38:13 devstack sudo[92554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:14 devstack sudo[92554]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee" returned: 0 in 0.760s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-quobyte-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee" released by "delete_volume" :: held 2.066s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:14 devstack sudo[92552]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-53cad194-2bf8-4715-a565-32ca45e967df tempest-VolumeQuotasNegativeTestJSON-1608803742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c27de1-6b67-4b26-a875-5dca2d21cdc1" returned: 0 in 0.966s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-53cad194-2bf8-4715-a565-32ca45e967df tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c27de1-6b67-4b26-a875-5dca2d21cdc1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:14 devstack sudo[92563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c27de1-6b67-4b26-a875-5dca2d21cdc1 Jul 10 04:38:14 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Created reservations ['b6a583a8-5f9d-4c3a-8e1d-53eb45060ead', '11af0f87-348c-476b-9c2d-b6382feea3fb', '2aba3542-17bc-4673-aae1-cee777bfe91b', '35b4d295-54ce-421e-965c-38beda97971b'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:38:14 devstack sudo[92563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:14 devstack sudo[92565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:38:14 devstack sudo[92565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d5f003f9-12c2-4166-8cbd-38e9dee4444d tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "cinder-0b6846df-8f41-409b-9fa7-0db77f899dc3-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d5f003f9-12c2-4166-8cbd-38e9dee4444d tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-0b6846df-8f41-409b-9fa7-0db77f899dc3-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d5f003f9-12c2-4166-8cbd-38e9dee4444d tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "cinder-quobyte-0b6846df-8f41-409b-9fa7-0db77f899dc3" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d5f003f9-12c2-4166-8cbd-38e9dee4444d tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-quobyte-0b6846df-8f41-409b-9fa7-0db77f899dc3" acquired by "delete_volume" :: waited 0.049s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:15 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[de08bbdf-5b99-45d8-8551-c477fd893e2e]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5f003f9-12c2-4166-8cbd-38e9dee4444d tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0b6846df-8f41-409b-9fa7-0db77f899dc3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:15 devstack sudo[92568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0b6846df-8f41-409b-9fa7-0db77f899dc3 Jul 10 04:38:15 devstack sudo[92568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:15 devstack sudo[92563]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-53cad194-2bf8-4715-a565-32ca45e967df tempest-VolumeQuotasNegativeTestJSON-1608803742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c27de1-6b67-4b26-a875-5dca2d21cdc1" returned: 0 in 1.044s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:38:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-53cad194-2bf8-4715-a565-32ca45e967df tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Lock "cinder-quobyte-24c27de1-6b67-4b26-a875-5dca2d21cdc1" released by "delete_volume" :: held 2.127s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:15 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:38:15 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:16 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-53cad194-2bf8-4715-a565-32ca45e967df tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Created reservations ['3fed3b77-7b91-4162-b131-2ef9bad64b4a', '208c1275-6052-435a-b1c8-4d5bdd94290a', '537239aa-15fd-4c3f-a13c-0f6b063300c8', '11ea8265-007d-440e-b6cd-71805e85baca'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:38:16 devstack sudo[92565]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.147s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:38:16 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Deleted volume successfully. Jul 10 04:38:16 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-354d04b6-220a-40ae-b577-4f241e639ce9 tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-d032a2d9-e084-4eee-9dd3-b5e7f170d2ee-delete_volume" released by "delete_volume" :: held 7.792s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-53cad194-2bf8-4715-a565-32ca45e967df tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-53cad194-2bf8-4715-a565-32ca45e967df tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:16 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-53cad194-2bf8-4715-a565-32ca45e967df tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:16 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-53cad194-2bf8-4715-a565-32ca45e967df tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-53cad194-2bf8-4715-a565-32ca45e967df tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-53cad194-2bf8-4715-a565-32ca45e967df tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:16 devstack sudo[92573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:38:16 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:17 devstack sudo[92568]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5f003f9-12c2-4166-8cbd-38e9dee4444d tempest-VolumesDeleteCascade-1554998591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0b6846df-8f41-409b-9fa7-0db77f899dc3" returned: 0 in 1.451s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5f003f9-12c2-4166-8cbd-38e9dee4444d tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0b6846df-8f41-409b-9fa7-0db77f899dc3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:17 devstack sudo[92580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0b6846df-8f41-409b-9fa7-0db77f899dc3 Jul 10 04:38:17 devstack sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:17 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-53cad194-2bf8-4715-a565-32ca45e967df tempest-VolumeQuotasNegativeTestJSON-1608803742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.962s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:17 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-53cad194-2bf8-4715-a565-32ca45e967df tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:38:17 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-53cad194-2bf8-4715-a565-32ca45e967df tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Deleted volume successfully. Jul 10 04:38:17 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-53cad194-2bf8-4715-a565-32ca45e967df tempest-VolumeQuotasNegativeTestJSON-1608803742 None] Lock "cinder-24c27de1-6b67-4b26-a875-5dca2d21cdc1-delete_volume" released by "delete_volume" :: held 3.518s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:17 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.338s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:17 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:38:17 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:38:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 8 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:38:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:38:18 devstack sudo[92580]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5f003f9-12c2-4166-8cbd-38e9dee4444d tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0b6846df-8f41-409b-9fa7-0db77f899dc3" returned: 0 in 1.023s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d5f003f9-12c2-4166-8cbd-38e9dee4444d tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-quobyte-0b6846df-8f41-409b-9fa7-0db77f899dc3" released by "delete_volume" :: held 2.557s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:18 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-d5f003f9-12c2-4166-8cbd-38e9dee4444d tempest-VolumesDeleteCascade-1554998591 None] Created reservations ['43c6f6ad-b94b-4db7-b746-01be499eb9e0', 'd624c9d7-9371-48ed-b8cf-d839f97663ff', '22eeeb09-5d76-4726-b4f1-731efa814fcf', '82a7e99e-942c-42c4-aaa8-60ae92e6c681'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:38:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5f003f9-12c2-4166-8cbd-38e9dee4444d tempest-VolumesDeleteCascade-1554998591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5f003f9-12c2-4166-8cbd-38e9dee4444d tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d5f003f9-12c2-4166-8cbd-38e9dee4444d tempest-VolumesDeleteCascade-1554998591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d5f003f9-12c2-4166-8cbd-38e9dee4444d tempest-VolumesDeleteCascade-1554998591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5f003f9-12c2-4166-8cbd-38e9dee4444d tempest-VolumesDeleteCascade-1554998591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5f003f9-12c2-4166-8cbd-38e9dee4444d tempest-VolumesDeleteCascade-1554998591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:18 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:38:18 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:18 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5f003f9-12c2-4166-8cbd-38e9dee4444d tempest-VolumesDeleteCascade-1554998591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.748s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:18 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-d5f003f9-12c2-4166-8cbd-38e9dee4444d tempest-VolumesDeleteCascade-1554998591 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:38:18 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d5f003f9-12c2-4166-8cbd-38e9dee4444d tempest-VolumesDeleteCascade-1554998591 None] Deleted volume successfully. Jul 10 04:38:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d5f003f9-12c2-4166-8cbd-38e9dee4444d tempest-VolumesDeleteCascade-1554998591 None] Lock "cinder-0b6846df-8f41-409b-9fa7-0db77f899dc3-delete_volume" released by "delete_volume" :: held 3.583s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Flow 'volume_create_manager' (191b3662-15b4-4084-ad0d-ea085f3dd990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0c87e10-d18b-417e-8a44-9452fbb01801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0c87e10-d18b-417e-8a44-9452fbb01801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1195197949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653640ca-bba5-4627-be61-1ceeec8e8cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac902d18982840da8a4d633f2a380633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:25Z,use_quota=True,user_id='84e5953ac1ba41daacb2abc03971fb77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89341771-dd51-4f60-9379-11f5c59dc480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89341771-dd51-4f60-9379-11f5c59dc480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbdfd80a-936d-4d46-b2e1-98d232592084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbdfd80a-936d-4d46-b2e1-98d232592084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '653640ca-bba5-4627-be61-1ceeec8e8cf8', 'volume_name': 'volume-653640ca-bba5-4627-be61-1ceeec8e8cf8', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfeb57a3-93ae-4b58-aa9a-90f7ca6671b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfeb57a3-93ae-4b58-aa9a-90f7ca6671b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214051b2-06af-4226-9afa-fccd48f7880e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:24 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Volume 653640ca-bba5-4627-be61-1ceeec8e8cf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-653640ca-bba5-4627-be61-1ceeec8e8cf8', 'volume_size': 1} Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1195197949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653640ca-bba5-4627-be61-1ceeec8e8cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac902d18982840da8a4d633f2a380633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:25Z,use_quota=True,user_id='84e5953ac1ba41daacb2abc03971fb77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Creating volume 653640ca-bba5-4627-be61-1ceeec8e8cf8 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:38:24 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-653640ca-bba5-4627-be61-1ceeec8e8cf8 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:24 devstack sudo[92607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-653640ca-bba5-4627-be61-1ceeec8e8cf8 1073741824 Jul 10 04:38:24 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:38:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Flow 'volume_create_manager' (94afacab-8f66-4340-a99f-c4ba1c80e953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f5d3ec-099a-44d9-8d10-cd902effdfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f5d3ec-099a-44d9-8d10-cd902effdfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-595967686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e02990-b0a4-4f9e-86e0-45d103d41e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df74984e630445384bfdd751cca2b5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:25Z,use_quota=True,user_id='d95efb91635a4218848ea8af5e7929fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6365fe03-2cc8-4ba9-9d3d-3d5a8d6a4941),volume_type_id=6365fe03-2cc8-4ba9-9d3d-3d5a8d6a4941)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806cfe67-a793-48f3-a34e-2dfedd0f68c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806cfe67-a793-48f3-a34e-2dfedd0f68c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b218b6ed-421f-4f34-aec2-8ea8fa5cd3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b218b6ed-421f-4f34-aec2-8ea8fa5cd3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53e02990-b0a4-4f9e-86e0-45d103d41e20', 'volume_name': 'volume-53e02990-b0a4-4f9e-86e0-45d103d41e20', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c04de5de-03f4-4e37-b2c9-ab97daf6eb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c04de5de-03f4-4e37-b2c9-ab97daf6eb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9d68f7-ea2d-474f-af37-03351f7b2d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:25 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Volume 53e02990-b0a4-4f9e-86e0-45d103d41e20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53e02990-b0a4-4f9e-86e0-45d103d41e20', 'volume_size': 1} Jul 10 04:38:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:25 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-653640ca-bba5-4627-be61-1ceeec8e8cf8 1073741824" returned: 0 in 0.993s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-653640ca-bba5-4627-be61-1ceeec8e8cf8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:25 devstack sudo[92613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-653640ca-bba5-4627-be61-1ceeec8e8cf8 Jul 10 04:38:25 devstack sudo[92613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:26 devstack sudo[92613]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-653640ca-bba5-4627-be61-1ceeec8e8cf8" returned: 0 in 0.645s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:38:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.565s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-595967686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e02990-b0a4-4f9e-86e0-45d103d41e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df74984e630445384bfdd751cca2b5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:25Z,use_quota=True,user_id='d95efb91635a4218848ea8af5e7929fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6365fe03-2cc8-4ba9-9d3d-3d5a8d6a4941),volume_type_id=6365fe03-2cc8-4ba9-9d3d-3d5a8d6a4941)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:38:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Creating volume 53e02990-b0a4-4f9e-86e0-45d103d41e20 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:38:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:38:26 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:38:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-53e02990-b0a4-4f9e-86e0-45d103d41e20 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:26 devstack sudo[92616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-53e02990-b0a4-4f9e-86e0-45d103d41e20 1073741824 Jul 10 04:38:26 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214051b2-06af-4226-9afa-fccd48f7880e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-653640ca-bba5-4627-be61-1ceeec8e8cf8', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c74deb32-18a4-4e56-972a-757be4d91d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:26 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Volume volume-653640ca-bba5-4627-be61-1ceeec8e8cf8 (653640ca-bba5-4627-be61-1ceeec8e8cf8): created successfully Jul 10 04:38:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c74deb32-18a4-4e56-972a-757be4d91d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Flow 'volume_create_manager' (191b3662-15b4-4084-ad0d-ea085f3dd990) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:26 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-f440782f-c012-479f-8e38-1eff4b839e4a tempest-VolumesTransfersTest-704196680 None] Created volume successfully. Jul 10 04:38:27 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-53e02990-b0a4-4f9e-86e0-45d103d41e20 1073741824" returned: 0 in 0.870s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-53e02990-b0a4-4f9e-86e0-45d103d41e20 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:27 devstack sudo[92622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-53e02990-b0a4-4f9e-86e0-45d103d41e20 Jul 10 04:38:27 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:28 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-53e02990-b0a4-4f9e-86e0-45d103d41e20" returned: 0 in 0.743s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:38:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9d68f7-ea2d-474f-af37-03351f7b2d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53e02990-b0a4-4f9e-86e0-45d103d41e20', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb93f17-33ac-488b-b6b0-4e5625e52425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:28 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Volume volume-53e02990-b0a4-4f9e-86e0-45d103d41e20 (53e02990-b0a4-4f9e-86e0-45d103d41e20): created successfully Jul 10 04:38:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb93f17-33ac-488b-b6b0-4e5625e52425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Flow 'volume_create_manager' (94afacab-8f66-4340-a99f-c4ba1c80e953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:28 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-81f75155-0fdb-4d36-9845-0fec3f6a7e29 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Created volume successfully. Jul 10 04:38:28 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-3ca2bdf8-664b-4ca6-a19b-097ba4b9962f tempest-VolumesTransfersTest-1617035325 None] Transfer volume completed successfully. Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6a11b811-02e4-4715-8b13-b589c4756f13 tempest-VolumesTransfersTest-633690949 None] Acquiring lock "cinder-653640ca-bba5-4627-be61-1ceeec8e8cf8-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6a11b811-02e4-4715-8b13-b589c4756f13 tempest-VolumesTransfersTest-633690949 None] Lock "cinder-653640ca-bba5-4627-be61-1ceeec8e8cf8-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Flow 'volume_create_manager' (775b2cea-4ea4-4e83-b1bf-b094e7a1fa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7bde282-7a33-4320-abd4-b01621062ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7bde282-7a33-4320-abd4-b01621062ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1060544066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3a3e202-0fc6-44b1-a86f-61dcac851e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15411bf75a4c478c989ad988097dbdfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:29Z,use_quota=True,user_id='63f87044dc3342b1abe652a0b60f6d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e817b7-c6bc-4d1e-968e-036b33554af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e817b7-c6bc-4d1e-968e-036b33554af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6e87b4-b0a3-42ec-816b-f8b2049de8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6e87b4-b0a3-42ec-816b-f8b2049de8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3a3e202-0fc6-44b1-a86f-61dcac851e8b', 'volume_name': 'volume-f3a3e202-0fc6-44b1-a86f-61dcac851e8b', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60af8d02-0ad9-497a-98a4-c291e623d2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60af8d02-0ad9-497a-98a4-c291e623d2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d20b1f-dbb0-4655-bf10-8dccd5fc8dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:29 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Volume f3a3e202-0fc6-44b1-a86f-61dcac851e8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3a3e202-0fc6-44b1-a86f-61dcac851e8b', 'volume_size': 1} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1060544066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3a3e202-0fc6-44b1-a86f-61dcac851e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15411bf75a4c478c989ad988097dbdfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:29Z,use_quota=True,user_id='63f87044dc3342b1abe652a0b60f6d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Creating volume f3a3e202-0fc6-44b1-a86f-61dcac851e8b {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:38:29 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f3a3e202-0fc6-44b1-a86f-61dcac851e8b 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:29 devstack sudo[92628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f3a3e202-0fc6-44b1-a86f-61dcac851e8b 1073741824 Jul 10 04:38:29 devstack sudo[92628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6a11b811-02e4-4715-8b13-b589c4756f13 tempest-VolumesTransfersTest-633690949 None] Acquiring lock "cinder-quobyte-653640ca-bba5-4627-be61-1ceeec8e8cf8" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6a11b811-02e4-4715-8b13-b589c4756f13 tempest-VolumesTransfersTest-633690949 None] Lock "cinder-quobyte-653640ca-bba5-4627-be61-1ceeec8e8cf8" acquired by "delete_volume" :: waited 0.026s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[698684e8-1fad-4f8c-93c4-9aee0bed4bf5]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6a11b811-02e4-4715-8b13-b589c4756f13 tempest-VolumesTransfersTest-633690949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-653640ca-bba5-4627-be61-1ceeec8e8cf8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0b63139d-2bcb-4a1f-8d50-b1e1609c4842 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0b63139d-2bcb-4a1f-8d50-b1e1609c4842 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-0b63139d-2bcb-4a1f-8d50-b1e1609c4842 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-0b63139d-2bcb-4a1f-8d50-b1e1609c4842 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0b63139d-2bcb-4a1f-8d50-b1e1609c4842 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0b63139d-2bcb-4a1f-8d50-b1e1609c4842 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:29 devstack sudo[92630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-653640ca-bba5-4627-be61-1ceeec8e8cf8 Jul 10 04:38:29 devstack sudo[92630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:29 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:38:29 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:30 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0b63139d-2bcb-4a1f-8d50-b1e1609c4842 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.871s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:30 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-0b63139d-2bcb-4a1f-8d50-b1e1609c4842 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:38:30 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-0b63139d-2bcb-4a1f-8d50-b1e1609c4842 tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Retype volume completed successfully. Jul 10 04:38:30 devstack sudo[92630]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6a11b811-02e4-4715-8b13-b589c4756f13 tempest-VolumesTransfersTest-633690949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-653640ca-bba5-4627-be61-1ceeec8e8cf8" returned: 0 in 1.045s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6a11b811-02e4-4715-8b13-b589c4756f13 tempest-VolumesTransfersTest-633690949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-653640ca-bba5-4627-be61-1ceeec8e8cf8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:30 devstack sudo[92628]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f3a3e202-0fc6-44b1-a86f-61dcac851e8b 1073741824" returned: 0 in 1.171s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:30 devstack sudo[92641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-653640ca-bba5-4627-be61-1ceeec8e8cf8 Jul 10 04:38:30 devstack sudo[92641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f3a3e202-0fc6-44b1-a86f-61dcac851e8b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:30 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f3a3e202-0fc6-44b1-a86f-61dcac851e8b Jul 10 04:38:30 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:31 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-4bf99997-7da4-49ed-87f6-8a2a7a00659c tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Acquiring lock "cinder-53e02990-b0a4-4f9e-86e0-45d103d41e20-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:31 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-4bf99997-7da4-49ed-87f6-8a2a7a00659c tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Lock "cinder-53e02990-b0a4-4f9e-86e0-45d103d41e20-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:31 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-4bf99997-7da4-49ed-87f6-8a2a7a00659c tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Acquiring lock "cinder-quobyte-53e02990-b0a4-4f9e-86e0-45d103d41e20" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:31 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-4bf99997-7da4-49ed-87f6-8a2a7a00659c tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Lock "cinder-quobyte-53e02990-b0a4-4f9e-86e0-45d103d41e20" acquired by "delete_volume" :: waited 0.027s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:31 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ad6a6b-5c71-4b47-818a-3a30be3f5ccb]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bf99997-7da4-49ed-87f6-8a2a7a00659c tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-53e02990-b0a4-4f9e-86e0-45d103d41e20 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:31 devstack sudo[92645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-53e02990-b0a4-4f9e-86e0-45d103d41e20 Jul 10 04:38:31 devstack sudo[92645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:31 devstack sudo[92641]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6a11b811-02e4-4715-8b13-b589c4756f13 tempest-VolumesTransfersTest-633690949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-653640ca-bba5-4627-be61-1ceeec8e8cf8" returned: 0 in 0.845s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:31 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6a11b811-02e4-4715-8b13-b589c4756f13 tempest-VolumesTransfersTest-633690949 None] Lock "cinder-quobyte-653640ca-bba5-4627-be61-1ceeec8e8cf8" released by "delete_volume" :: held 1.970s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:31 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f3a3e202-0fc6-44b1-a86f-61dcac851e8b" returned: 0 in 0.923s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:31 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] <== create_volume: return (2149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:38:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.152s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d20b1f-dbb0-4655-bf10-8dccd5fc8dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3a3e202-0fc6-44b1-a86f-61dcac851e8b', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f3f459-6a60-4b67-8335-1b137e5bc8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:31 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-6a11b811-02e4-4715-8b13-b589c4756f13 tempest-VolumesTransfersTest-633690949 None] Created reservations ['6f498f71-a28c-4bbd-ab38-31754ada34bd', '485d5b43-7798-4484-91c1-f040bd442514', '98c2788f-d0c4-4a07-93e5-16e644e010a3', '32890eb6-66fb-443a-a0d0-b74a08f1ceec'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:38:31 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Volume volume-f3a3e202-0fc6-44b1-a86f-61dcac851e8b (f3a3e202-0fc6-44b1-a86f-61dcac851e8b): created successfully Jul 10 04:38:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f3f459-6a60-4b67-8335-1b137e5bc8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Flow 'volume_create_manager' (775b2cea-4ea4-4e83-b1bf-b094e7a1fa28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:31 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-fa11c083-6f9d-43f0-9775-c4eb073adad2 tempest-AttachVolumeNegativeTest-351970016 None] Created volume successfully. Jul 10 04:38:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6a11b811-02e4-4715-8b13-b589c4756f13 tempest-VolumesTransfersTest-633690949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6a11b811-02e4-4715-8b13-b589c4756f13 tempest-VolumesTransfersTest-633690949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:31 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6a11b811-02e4-4715-8b13-b589c4756f13 tempest-VolumesTransfersTest-633690949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:31 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6a11b811-02e4-4715-8b13-b589c4756f13 tempest-VolumesTransfersTest-633690949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6a11b811-02e4-4715-8b13-b589c4756f13 tempest-VolumesTransfersTest-633690949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6a11b811-02e4-4715-8b13-b589c4756f13 tempest-VolumesTransfersTest-633690949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:32 devstack sudo[92649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:38:32 devstack sudo[92649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:32 devstack sudo[92645]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bf99997-7da4-49ed-87f6-8a2a7a00659c tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-53e02990-b0a4-4f9e-86e0-45d103d41e20" returned: 0 in 0.946s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bf99997-7da4-49ed-87f6-8a2a7a00659c tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-53e02990-b0a4-4f9e-86e0-45d103d41e20 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:32 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-53e02990-b0a4-4f9e-86e0-45d103d41e20 Jul 10 04:38:32 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:32 devstack sudo[92649]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6a11b811-02e4-4715-8b13-b589c4756f13 tempest-VolumesTransfersTest-633690949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.882s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:32 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-6a11b811-02e4-4715-8b13-b589c4756f13 tempest-VolumesTransfersTest-633690949 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:38:32 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-6a11b811-02e4-4715-8b13-b589c4756f13 tempest-VolumesTransfersTest-633690949 None] Deleted volume successfully. Jul 10 04:38:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6a11b811-02e4-4715-8b13-b589c4756f13 tempest-VolumesTransfersTest-633690949 None] Lock "cinder-653640ca-bba5-4627-be61-1ceeec8e8cf8-delete_volume" released by "delete_volume" :: held 3.381s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:33 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bf99997-7da4-49ed-87f6-8a2a7a00659c tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-53e02990-b0a4-4f9e-86e0-45d103d41e20" returned: 0 in 0.861s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-4bf99997-7da4-49ed-87f6-8a2a7a00659c tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Lock "cinder-quobyte-53e02990-b0a4-4f9e-86e0-45d103d41e20" released by "delete_volume" :: held 1.870s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:33 devstack cinder-volume[87359]: WARNING cinder.quota [None req-4bf99997-7da4-49ed-87f6-8a2a7a00659c tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:38:33 devstack cinder-volume[87359]: WARNING cinder.quota [None req-4bf99997-7da4-49ed-87f6-8a2a7a00659c tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-4bf99997-7da4-49ed-87f6-8a2a7a00659c tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Created reservations ['8c184e22-a642-4f1e-9ba7-6e0718f8e5cb', '5169e515-89e6-4776-8674-b48ad23981ed', '7540e214-1698-460e-b42c-33bf5432e884', 'cdb4ef81-1270-47cd-80c9-c392aed8ec73'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4bf99997-7da4-49ed-87f6-8a2a7a00659c tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4bf99997-7da4-49ed-87f6-8a2a7a00659c tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4bf99997-7da4-49ed-87f6-8a2a7a00659c tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4bf99997-7da4-49ed-87f6-8a2a7a00659c tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4bf99997-7da4-49ed-87f6-8a2a7a00659c tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bf99997-7da4-49ed-87f6-8a2a7a00659c tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:33 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:38:33 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Flow 'volume_create_manager' (ce03dd53-2147-40de-9402-c9d868a8c1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13573e64-143c-41b6-95b9-d3034f511f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13573e64-143c-41b6-95b9-d3034f511f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-237732258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce0c2116-3a5d-4f68-968a-a168de993b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac902d18982840da8a4d633f2a380633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:33Z,use_quota=True,user_id='84e5953ac1ba41daacb2abc03971fb77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d2157bc-cfc9-4bb7-b042-bf947d8c5c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d2157bc-cfc9-4bb7-b042-bf947d8c5c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9832227-623f-45f7-a3ee-9f48966e7458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9832227-623f-45f7-a3ee-9f48966e7458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce0c2116-3a5d-4f68-968a-a168de993b6f', 'volume_name': 'volume-ce0c2116-3a5d-4f68-968a-a168de993b6f', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a09528-1508-44fc-836a-3ca53a6f667c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a09528-1508-44fc-836a-3ca53a6f667c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a8c3bb-f5eb-412c-b736-b9269d913bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:33 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Volume ce0c2116-3a5d-4f68-968a-a168de993b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce0c2116-3a5d-4f68-968a-a168de993b6f', 'volume_size': 1} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-237732258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce0c2116-3a5d-4f68-968a-a168de993b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac902d18982840da8a4d633f2a380633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:33Z,use_quota=True,user_id='84e5953ac1ba41daacb2abc03971fb77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Creating volume ce0c2116-3a5d-4f68-968a-a168de993b6f {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:38:33 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:38:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce0c2116-3a5d-4f68-968a-a168de993b6f 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:33 devstack sudo[92665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce0c2116-3a5d-4f68-968a-a168de993b6f 1073741824 Jul 10 04:38:33 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:34 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bf99997-7da4-49ed-87f6-8a2a7a00659c tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.903s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:34 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-4bf99997-7da4-49ed-87f6-8a2a7a00659c tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:38:34 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-4bf99997-7da4-49ed-87f6-8a2a7a00659c tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Deleted volume successfully. Jul 10 04:38:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-4bf99997-7da4-49ed-87f6-8a2a7a00659c tempest-VolumeRetypeWithoutMigrationTest-1001742194 None] Lock "cinder-53e02990-b0a4-4f9e-86e0-45d103d41e20-delete_volume" released by "delete_volume" :: held 3.069s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:34 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce0c2116-3a5d-4f68-968a-a168de993b6f 1073741824" returned: 0 in 0.966s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce0c2116-3a5d-4f68-968a-a168de993b6f {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:34 devstack sudo[92672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce0c2116-3a5d-4f68-968a-a168de993b6f Jul 10 04:38:34 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:35 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce0c2116-3a5d-4f68-968a-a168de993b6f" returned: 0 in 0.883s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:38:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a8c3bb-f5eb-412c-b736-b9269d913bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce0c2116-3a5d-4f68-968a-a168de993b6f', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5ee0a6-c7a2-4617-a52e-fe2f787bec8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:35 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Volume volume-ce0c2116-3a5d-4f68-968a-a168de993b6f (ce0c2116-3a5d-4f68-968a-a168de993b6f): created successfully Jul 10 04:38:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5ee0a6-c7a2-4617-a52e-fe2f787bec8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Flow 'volume_create_manager' (ce03dd53-2147-40de-9402-c9d868a8c1b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:35 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-505e2d1b-09aa-425e-9219-4d400f15efa3 tempest-VolumesTransfersTest-704196680 None] Created volume successfully. Jul 10 04:38:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-56ab11ab-a528-47ee-b34c-b1120a2ffaa6 req-159a3263-8ec4-4620-9f06-efc21c957534 tempest-AttachVolumeNegativeTest-351970016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-56ab11ab-a528-47ee-b34c-b1120a2ffaa6 req-159a3263-8ec4-4620-9f06-efc21c957534 tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:36 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[d933fc02-d9b5-4d8a-9257-07e2091437cf]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-56ab11ab-a528-47ee-b34c-b1120a2ffaa6 req-159a3263-8ec4-4620-9f06-efc21c957534 tempest-AttachVolumeNegativeTest-351970016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f3a3e202-0fc6-44b1-a86f-61dcac851e8b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:36 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f3a3e202-0fc6-44b1-a86f-61dcac851e8b Jul 10 04:38:36 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2529aa97-0e5e-427c-8429-188b33ad813f tempest-VolumesTransfersTest-633690949 None] Acquiring lock "cinder-ce0c2116-3a5d-4f68-968a-a168de993b6f-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2529aa97-0e5e-427c-8429-188b33ad813f tempest-VolumesTransfersTest-633690949 None] Lock "cinder-ce0c2116-3a5d-4f68-968a-a168de993b6f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2529aa97-0e5e-427c-8429-188b33ad813f tempest-VolumesTransfersTest-633690949 None] Acquiring lock "cinder-quobyte-ce0c2116-3a5d-4f68-968a-a168de993b6f" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2529aa97-0e5e-427c-8429-188b33ad813f tempest-VolumesTransfersTest-633690949 None] Lock "cinder-quobyte-ce0c2116-3a5d-4f68-968a-a168de993b6f" acquired by "delete_volume" :: waited 0.025s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:37 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c957c3b-a3b1-4178-a16c-0951d1bcde21]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2529aa97-0e5e-427c-8429-188b33ad813f tempest-VolumesTransfersTest-633690949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce0c2116-3a5d-4f68-968a-a168de993b6f {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:37 devstack sudo[92692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce0c2116-3a5d-4f68-968a-a168de993b6f Jul 10 04:38:37 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:37 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-56ab11ab-a528-47ee-b34c-b1120a2ffaa6 req-159a3263-8ec4-4620-9f06-efc21c957534 tempest-AttachVolumeNegativeTest-351970016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f3a3e202-0fc6-44b1-a86f-61dcac851e8b" returned: 0 in 0.916s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-56ab11ab-a528-47ee-b34c-b1120a2ffaa6 req-159a3263-8ec4-4620-9f06-efc21c957534 tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.933s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-56ab11ab-a528-47ee-b34c-b1120a2ffaa6 req-159a3263-8ec4-4620-9f06-efc21c957534 tempest-AttachVolumeNegativeTest-351970016 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31', 'name': 'volume-f3a3e202-0fc6-44b1-a86f-61dcac851e8b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '576fc93c-6c19-4cc9-89d8-da840c8c7b0c', 'enforce_multipath': True} {{(pid=87359) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4975}} Jul 10 04:38:37 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-56ab11ab-a528-47ee-b34c-b1120a2ffaa6 req-159a3263-8ec4-4620-9f06-efc21c957534 tempest-AttachVolumeNegativeTest-351970016 None] attachment_update completed successfully. Jul 10 04:38:38 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2529aa97-0e5e-427c-8429-188b33ad813f tempest-VolumesTransfersTest-633690949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce0c2116-3a5d-4f68-968a-a168de993b6f" returned: 0 in 0.927s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2529aa97-0e5e-427c-8429-188b33ad813f tempest-VolumesTransfersTest-633690949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce0c2116-3a5d-4f68-968a-a168de993b6f {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:38 devstack sudo[92765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce0c2116-3a5d-4f68-968a-a168de993b6f Jul 10 04:38:38 devstack sudo[92765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:38 devstack sudo[92765]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2529aa97-0e5e-427c-8429-188b33ad813f tempest-VolumesTransfersTest-633690949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ce0c2116-3a5d-4f68-968a-a168de993b6f" returned: 0 in 0.743s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2529aa97-0e5e-427c-8429-188b33ad813f tempest-VolumesTransfersTest-633690949 None] Lock "cinder-quobyte-ce0c2116-3a5d-4f68-968a-a168de993b6f" released by "delete_volume" :: held 1.727s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:38 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-2529aa97-0e5e-427c-8429-188b33ad813f tempest-VolumesTransfersTest-633690949 None] Created reservations ['94017dff-d74b-4105-a63f-7b2d0c8fffd1', 'c4ca5e2e-fcfb-4f52-9b80-d415a62068d4', 'dcd55614-08a1-419f-a409-594d10f2015d', '8f97b93a-2767-4d2d-97bd-e7ea01a44458'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:38:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2529aa97-0e5e-427c-8429-188b33ad813f tempest-VolumesTransfersTest-633690949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2529aa97-0e5e-427c-8429-188b33ad813f tempest-VolumesTransfersTest-633690949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2529aa97-0e5e-427c-8429-188b33ad813f tempest-VolumesTransfersTest-633690949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2529aa97-0e5e-427c-8429-188b33ad813f tempest-VolumesTransfersTest-633690949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2529aa97-0e5e-427c-8429-188b33ad813f tempest-VolumesTransfersTest-633690949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2529aa97-0e5e-427c-8429-188b33ad813f tempest-VolumesTransfersTest-633690949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:39 devstack sudo[93088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:38:39 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:39 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2529aa97-0e5e-427c-8429-188b33ad813f tempest-VolumesTransfersTest-633690949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.792s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:39 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-2529aa97-0e5e-427c-8429-188b33ad813f tempest-VolumesTransfersTest-633690949 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:38:39 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-2529aa97-0e5e-427c-8429-188b33ad813f tempest-VolumesTransfersTest-633690949 None] Deleted volume successfully. Jul 10 04:38:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2529aa97-0e5e-427c-8429-188b33ad813f tempest-VolumesTransfersTest-633690949 None] Lock "cinder-ce0c2116-3a5d-4f68-968a-a168de993b6f-delete_volume" released by "delete_volume" :: held 2.829s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:44 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=100,cinder:INSERT=26,cinder:UPDATE=126,cinder:DELETE=10 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:38:44 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=93,cinder:INSERT=31,cinder:UPDATE=122,cinder:DELETE=10 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:38:44 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-20824a28-02ef-4992-a706-52a7f6fd0bd9 req-ac1d3373-1f9c-4343-a436-177c57ffa01f tempest-AttachVolumeNegativeTest-351970016 None] Terminate volume connection completed successfully. Jul 10 04:38:44 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-20824a28-02ef-4992-a706-52a7f6fd0bd9 req-ac1d3373-1f9c-4343-a436-177c57ffa01f tempest-AttachVolumeNegativeTest-351970016 None] Deleting attachment 576fc93c-6c19-4cc9-89d8-da840c8c7b0c. {{(pid=87359) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5106}} Jul 10 04:38:48 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:38:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Flow 'volume_create_manager' (a522ffac-71df-42ef-b7fe-b07516d16a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4420a6c-d990-4cc9-9120-c7ef42c766d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4420a6c-d990-4cc9-9120-c7ef42c766d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-906393737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0810c234-f11a-426f-b670-5a15adf0b2e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a71abd9ec5a4412686da665b400cd720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:48Z,use_quota=True,user_id='dd836fac4fb045a890b76e25300061ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b8d910-870a-4e22-a54f-17e51a39197d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b8d910-870a-4e22-a54f-17e51a39197d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a67372-176f-4ec1-bff4-fa4bb3af5263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a67372-176f-4ec1-bff4-fa4bb3af5263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0810c234-f11a-426f-b670-5a15adf0b2e9', 'volume_name': 'volume-0810c234-f11a-426f-b670-5a15adf0b2e9', 'volume_size': 2}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd4a128-7be3-4253-b20c-6d8277dc559a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd4a128-7be3-4253-b20c-6d8277dc559a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a815bd7d-bcac-42e8-806d-5e648d143af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:48 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Volume 0810c234-f11a-426f-b670-5a15adf0b2e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0810c234-f11a-426f-b670-5a15adf0b2e9', 'volume_size': 2} Jul 10 04:38:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-906393737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0810c234-f11a-426f-b670-5a15adf0b2e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a71abd9ec5a4412686da665b400cd720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:48Z,use_quota=True,user_id='dd836fac4fb045a890b76e25300061ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:38:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Creating volume 0810c234-f11a-426f-b670-5a15adf0b2e9 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:38:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:38:48 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:38:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0810c234-f11a-426f-b670-5a15adf0b2e9 2147483648 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:48 devstack sudo[93189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0810c234-f11a-426f-b670-5a15adf0b2e9 2147483648 Jul 10 04:38:48 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:49 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0810c234-f11a-426f-b670-5a15adf0b2e9 2147483648" returned: 0 in 1.415s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0810c234-f11a-426f-b670-5a15adf0b2e9 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:49 devstack sudo[93231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0810c234-f11a-426f-b670-5a15adf0b2e9 Jul 10 04:38:49 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:50 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0810c234-f11a-426f-b670-5a15adf0b2e9" returned: 0 in 0.928s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] <== create_volume: return (2426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:38:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.428s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a815bd7d-bcac-42e8-806d-5e648d143af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0810c234-f11a-426f-b670-5a15adf0b2e9', 'volume_size': 2}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56bbe378-29bb-46c5-a4f2-18089a6b8a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:50 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Volume volume-0810c234-f11a-426f-b670-5a15adf0b2e9 (0810c234-f11a-426f-b670-5a15adf0b2e9): created successfully Jul 10 04:38:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56bbe378-29bb-46c5-a4f2-18089a6b8a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Flow 'volume_create_manager' (a522ffac-71df-42ef-b7fe-b07516d16a08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:50 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-48bf8283-d33a-40d4-b970-7d1f293730b9 tempest-VolumesCloneNegativeTest-1120821627 None] Created volume successfully. Jul 10 04:38:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-232097e9-9ff4-445a-b6d9-b5c487638388 tempest-VolumesCloneNegativeTest-1120821627 None] Acquiring lock "cinder-0810c234-f11a-426f-b670-5a15adf0b2e9-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-232097e9-9ff4-445a-b6d9-b5c487638388 tempest-VolumesCloneNegativeTest-1120821627 None] Lock "cinder-0810c234-f11a-426f-b670-5a15adf0b2e9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-232097e9-9ff4-445a-b6d9-b5c487638388 tempest-VolumesCloneNegativeTest-1120821627 None] Acquiring lock "cinder-quobyte-0810c234-f11a-426f-b670-5a15adf0b2e9" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-232097e9-9ff4-445a-b6d9-b5c487638388 tempest-VolumesCloneNegativeTest-1120821627 None] Lock "cinder-quobyte-0810c234-f11a-426f-b670-5a15adf0b2e9" acquired by "delete_volume" :: waited 0.038s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:51 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f91633-dbb5-4ae8-b2c1-cba912bdacf3]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-232097e9-9ff4-445a-b6d9-b5c487638388 tempest-VolumesCloneNegativeTest-1120821627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0810c234-f11a-426f-b670-5a15adf0b2e9 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:52 devstack sudo[93239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0810c234-f11a-426f-b670-5a15adf0b2e9 Jul 10 04:38:52 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:53 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-232097e9-9ff4-445a-b6d9-b5c487638388 tempest-VolumesCloneNegativeTest-1120821627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0810c234-f11a-426f-b670-5a15adf0b2e9" returned: 0 in 1.253s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-232097e9-9ff4-445a-b6d9-b5c487638388 tempest-VolumesCloneNegativeTest-1120821627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0810c234-f11a-426f-b670-5a15adf0b2e9 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:53 devstack sudo[93245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0810c234-f11a-426f-b670-5a15adf0b2e9 Jul 10 04:38:53 devstack sudo[93245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:54 devstack sudo[93245]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-232097e9-9ff4-445a-b6d9-b5c487638388 tempest-VolumesCloneNegativeTest-1120821627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0810c234-f11a-426f-b670-5a15adf0b2e9" returned: 0 in 0.998s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-232097e9-9ff4-445a-b6d9-b5c487638388 tempest-VolumesCloneNegativeTest-1120821627 None] Lock "cinder-quobyte-0810c234-f11a-426f-b670-5a15adf0b2e9" released by "delete_volume" :: held 2.364s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:54 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-232097e9-9ff4-445a-b6d9-b5c487638388 tempest-VolumesCloneNegativeTest-1120821627 None] Created reservations ['81a74152-7129-407f-a2e3-a0f5bf603341', 'f68df4a7-0a92-488b-8daf-2b3303ddfede', '6738eb6b-989d-4514-ab3b-56ad181e9ade', '89962905-1d87-4569-b5b6-9726c56804f0'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:38:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-232097e9-9ff4-445a-b6d9-b5c487638388 tempest-VolumesCloneNegativeTest-1120821627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-232097e9-9ff4-445a-b6d9-b5c487638388 tempest-VolumesCloneNegativeTest-1120821627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-232097e9-9ff4-445a-b6d9-b5c487638388 tempest-VolumesCloneNegativeTest-1120821627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-232097e9-9ff4-445a-b6d9-b5c487638388 tempest-VolumesCloneNegativeTest-1120821627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-232097e9-9ff4-445a-b6d9-b5c487638388 tempest-VolumesCloneNegativeTest-1120821627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-232097e9-9ff4-445a-b6d9-b5c487638388 tempest-VolumesCloneNegativeTest-1120821627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:54 devstack sudo[93251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:38:54 devstack sudo[93251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:55 devstack sudo[93251]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-232097e9-9ff4-445a-b6d9-b5c487638388 tempest-VolumesCloneNegativeTest-1120821627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.018s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:55 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-232097e9-9ff4-445a-b6d9-b5c487638388 tempest-VolumesCloneNegativeTest-1120821627 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:38:55 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-232097e9-9ff4-445a-b6d9-b5c487638388 tempest-VolumesCloneNegativeTest-1120821627 None] Deleted volume successfully. Jul 10 04:38:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-232097e9-9ff4-445a-b6d9-b5c487638388 tempest-VolumesCloneNegativeTest-1120821627 None] Lock "cinder-0810c234-f11a-426f-b670-5a15adf0b2e9-delete_volume" released by "delete_volume" :: held 3.762s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:01 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:39:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Flow 'volume_create_manager' (a31af8f9-1abe-42bc-a6e1-736e7b50b789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1cb63e-642f-4c5e-a514-f73e864814fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1cb63e-642f-4c5e-a514-f73e864814fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2008363432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9010ee9668d49bba41e5b561aec5b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:01Z,use_quota=True,user_id='ce8eac92bd2742c9b0582627a8da5d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b180bab-942d-4c28-87ac-d7a980c9781b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b180bab-942d-4c28-87ac-d7a980c9781b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d948590-7757-4211-bb55-c1917a5ce922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:01 devstack cinder-volume[87359]: DEBUG cinder.image.glance [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Creating Keystone auth plugin from conf {{(pid=87359) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 04:39:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d948590-7757-4211-bb55-c1917a5ce922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28', 'volume_name': 'volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28', 'volume_size': 1, 'image_id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fde3189e780b4bb09257315f8463a754', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'created_at': datetime.datetime(2026, 7, 10, 2, 27, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 27, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f148b33-7c87-45fa-9b71-3295f9e93abc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a4710d5-82d2-4da1-b323-dc7437dda10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a4710d5-82d2-4da1-b323-dc7437dda10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31a8fdd-5a3e-42a5-9519-fa45f254ff76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:02 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Volume bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28', 'volume_size': 1, 'image_id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fde3189e780b4bb09257315f8463a754', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'created_at': datetime.datetime(2026, 7, 10, 2, 27, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 27, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f148b33-7c87-45fa-9b71-3295f9e93abc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 04:39:02 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Trying to clone bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 from image 7f148b33-7c87-45fa-9b71-3295f9e93abc at location (None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}]). {{(pid=87359) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 04:39:02 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_jy29gmjwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Jul 10 04:39:02 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Image download 20.69 MB at 20.69 MB/s Jul 10 04:39:02 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2b9f1b-6727-41a9-b1dd-2b4ed598c068]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_jy29gmjwdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:03 devstack sudo[93360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_jy29gmjwdevstack@QuobyteHD Jul 10 04:39:03 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:03 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_jy29gmjwdevstack@QuobyteHD" returned: 0 in 0.991s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:03 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Temporary image 7f148b33-7c87-45fa-9b71-3295f9e93abc is fetched for user ce8eac92bd2742c9b0582627a8da5d8a. {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Jul 10 04:39:03 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[b980bd0f-454c-40e6-b85a-d5ef73daa82c]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_jy29gmjwdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:04 devstack sudo[93366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_jy29gmjwdevstack@QuobyteHD Jul 10 04:39:04 devstack sudo[93366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:04 devstack sudo[93366]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_jy29gmjwdevstack@QuobyteHD" returned: 0 in 0.947s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:04 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2008363432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9010ee9668d49bba41e5b561aec5b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:01Z,use_quota=True,user_id='ce8eac92bd2742c9b0582627a8da5d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:39:04 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Creating volume bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:39:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:04 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:04 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:04 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:39:04 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:39:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:04 devstack sudo[93374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 1073741824 Jul 10 04:39:04 devstack sudo[93374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:05 devstack sudo[93374]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 1073741824" returned: 0 in 1.038s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:06 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 Jul 10 04:39:06 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:06 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28" returned: 0 in 0.698s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:39:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:06 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Attempting download of 7f148b33-7c87-45fa-9b71-3295f9e93abc ((None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}])) to volume bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28. {{(pid=87359) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 04:39:06 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[689e016d-f275-40f1-aebb-62e8a4af512f]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_ljnfxwq4 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:06 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_ljnfxwq4 Jul 10 04:39:06 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:07 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_ljnfxwq4" returned: 0 in 0.881s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_ljnfxwq4 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:07 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_ljnfxwq4 Jul 10 04:39:07 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:08 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_ljnfxwq4" returned: 1 in 0.798s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_ljnfxwq4' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:39:08 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bffb92f-70ef-4abf-8152-28c8e4557b45]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_jy29gmjwdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:08 devstack sudo[93413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_jy29gmjwdevstack@QuobyteHD Jul 10 04:39:08 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:09 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_jy29gmjwdevstack@QuobyteHD" returned: 0 in 1.047s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:09 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] 7f148b33-7c87-45fa-9b71-3295f9e93abc was qcow2, converting to raw {{(pid=87359) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Jul 10 04:39:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_jy29gmjwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:09 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_jy29gmjwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 Jul 10 04:39:09 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:13 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_jy29gmjwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28" returned: 0 in 4.214s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:13 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_jy29gmjwdevstack@QuobyteHD, size 112.00 MB, duration 4.22 sec, destination /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:39:13 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Converted 112.00 MB image at 26.55 MB/s Jul 10 04:39:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:13 devstack sudo[93491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 1G Jul 10 04:39:13 devstack sudo[93491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:14 devstack sudo[93491]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 1G" returned: 0 in 1.165s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:14 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[df60a804-fb0e-470f-b58a-9e89fec69292]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:15 devstack sudo[93497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 Jul 10 04:39:15 devstack sudo[93497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:39:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:15 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:39:15 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:16 devstack sudo[93497]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28" returned: 0 in 1.184s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:16 devstack sudo[93503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 Jul 10 04:39:16 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:16 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=8,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:39:16 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=12,cinder:UPDATE=16,cinder:INSERT=3 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:39:17 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.385s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:17 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:39:17 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28" returned: 1 in 1.196s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:39:17 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Downloaded image 7f148b33-7c87-45fa-9b71-3295f9e93abc ((None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}])) to volume bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 successfully. {{(pid=87359) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 04:39:17 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Temporary image 7f148b33-7c87-45fa-9b71-3295f9e93abc for user ce8eac92bd2742c9b0582627a8da5d8a is deleted. {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Jul 10 04:39:17 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Marking volume bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 as bootable. {{(pid=87359) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 04:39:17 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Copying metadata from image 7f148b33-7c87-45fa-9b71-3295f9e93abc to bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28. {{(pid=87359) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 04:39:17 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Creating volume glance metadata for volume bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 backed by image 7f148b33-7c87-45fa-9b71-3295f9e93abc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87359) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 04:39:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31a8fdd-5a3e-42a5-9519-fa45f254ff76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28', 'volume_size': 1, 'image_id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fde3189e780b4bb09257315f8463a754', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'created_at': datetime.datetime(2026, 7, 10, 2, 27, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 27, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f148b33-7c87-45fa-9b71-3295f9e93abc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23062a3e-8610-49d7-8ffe-c478c8f77657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:17 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Volume volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 (bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28): created successfully Jul 10 04:39:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23062a3e-8610-49d7-8ffe-c478c8f77657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Flow 'volume_create_manager' (a31af8f9-1abe-42bc-a6e1-736e7b50b789) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:17 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-8dd83b37-ca82-46d8-a8d2-45740c92d3a1 tempest-VolumesExtendTest-2066137391 None] Created volume successfully. Jul 10 04:39:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8a28632a-4678-4d54-b937-de8cafe2e627 tempest-VolumesExtendTest-2066137391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8a28632a-4678-4d54-b937-de8cafe2e627 tempest-VolumesExtendTest-2066137391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:18 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[0040cd3c-6baf-4c0a-8977-901c6a014efb]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8a28632a-4678-4d54-b937-de8cafe2e627 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:18 devstack sudo[93536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 Jul 10 04:39:18 devstack sudo[93536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:19 devstack sudo[93536]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8a28632a-4678-4d54-b937-de8cafe2e627 tempest-VolumesExtendTest-2066137391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28" returned: 0 in 1.232s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8a28632a-4678-4d54-b937-de8cafe2e627 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:20 devstack sudo[93582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 Jul 10 04:39:20 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:20 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8a28632a-4678-4d54-b937-de8cafe2e627 tempest-VolumesExtendTest-2066137391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28" returned: 1 in 1.004s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8a28632a-4678-4d54-b937-de8cafe2e627 tempest-VolumesExtendTest-2066137391 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:39:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8a28632a-4678-4d54-b937-de8cafe2e627 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 2G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8a28632a-4678-4d54-b937-de8cafe2e627 tempest-VolumesExtendTest-2066137391 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 2G" returned: 0 in 0.095s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8a28632a-4678-4d54-b937-de8cafe2e627 tempest-VolumesExtendTest-2066137391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.526s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:21 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-8a28632a-4678-4d54-b937-de8cafe2e627 tempest-VolumesExtendTest-2066137391 None] Extend volume completed successfully. Jul 10 04:39:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] Acquiring lock "cinder-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] Lock "cinder-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] Acquiring lock "cinder-quobyte-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] Lock "cinder-quobyte-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28" acquired by "delete_volume" :: waited 0.022s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:22 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb359477-ab25-4cb9-9c2d-ed4ed5894fbd]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:22 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 Jul 10 04:39:22 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:23 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28" returned: 0 in 1.299s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:23 devstack sudo[93618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 Jul 10 04:39:23 devstack sudo[93618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:24 devstack sudo[93618]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28" returned: 1 in 1.166s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:39:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:24 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28 Jul 10 04:39:24 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:25 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28" returned: 0 in 0.805s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:25 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] Lock "cinder-quobyte-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28" released by "delete_volume" :: held 3.366s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:25 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] Created reservations ['8e079fe9-dc9e-486e-8626-015871b80b0d', '0cac6e2a-9047-4c7f-a45b-7ceb44bcfb25', '252388c8-40bc-4b48-97d6-06fba8aacaa7', 'ef150a6f-c2a8-42d2-993a-450dddff9c8b'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:39:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:26 devstack sudo[93628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:39:26 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:26 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:39:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Flow 'volume_create_manager' (1b31c7f6-cb31-4cee-9116-784aec0bb84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e93392e-58ec-4405-8288-24e29c86f0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e93392e-58ec-4405-8288-24e29c86f0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-886815226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bc6f2a3-e2b9-4d20-8474-0cb015f0e634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66919765b21d420e9810a863dad633df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:26Z,use_quota=True,user_id='4754f918d9f14bc39c2ab1a29768c969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20d1eab-f0d4-471c-a2ac-8988ffc3f1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20d1eab-f0d4-471c-a2ac-8988ffc3f1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068204d2-9cbe-479d-a81a-9ce3d5c1a9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068204d2-9cbe-479d-a81a-9ce3d5c1a9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bc6f2a3-e2b9-4d20-8474-0cb015f0e634', 'volume_name': 'volume-6bc6f2a3-e2b9-4d20-8474-0cb015f0e634', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b962a45-bf24-43c4-b0e6-121a56592dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b962a45-bf24-43c4-b0e6-121a56592dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d14887-2f7d-453b-be07-b763eb050f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:26 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Volume 6bc6f2a3-e2b9-4d20-8474-0cb015f0e634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bc6f2a3-e2b9-4d20-8474-0cb015f0e634', 'volume_size': 1} Jul 10 04:39:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-886815226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bc6f2a3-e2b9-4d20-8474-0cb015f0e634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66919765b21d420e9810a863dad633df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:26Z,use_quota=True,user_id='4754f918d9f14bc39c2ab1a29768c969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:39:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Creating volume 6bc6f2a3-e2b9-4d20-8474-0cb015f0e634 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:39:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:39:26 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:39:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-6bc6f2a3-e2b9-4d20-8474-0cb015f0e634 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:26 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-6bc6f2a3-e2b9-4d20-8474-0cb015f0e634 1073741824 Jul 10 04:39:26 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:27 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.174s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:27 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:39:27 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] Deleted volume successfully. Jul 10 04:39:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9afe290b-69ef-434a-ae9e-f39a0bfca1a5 tempest-VolumesExtendTest-2066137391 None] Lock "cinder-bc848225-b1ee-4ff1-b3ed-1ab5dcbe1b28-delete_volume" released by "delete_volume" :: held 4.861s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:27 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:39:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Flow 'volume_create_manager' (199dfdf6-4491-4cf1-ba7d-516038eb9e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a57df09-1c0b-4e0a-a1aa-29bfe9f489f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a57df09-1c0b-4e0a-a1aa-29bfe9f489f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-421942709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a3ba8ae-607a-4855-b70d-0091b805197b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9010ee9668d49bba41e5b561aec5b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:28Z,use_quota=True,user_id='ce8eac92bd2742c9b0582627a8da5d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791ded1a-61f8-4876-88d0-cc2d2aa7c9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791ded1a-61f8-4876-88d0-cc2d2aa7c9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37124a20-3b5e-4c83-90ac-bc346cefe251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37124a20-3b5e-4c83-90ac-bc346cefe251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a3ba8ae-607a-4855-b70d-0091b805197b', 'volume_name': 'volume-7a3ba8ae-607a-4855-b70d-0091b805197b', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838e8a4f-3dcd-4d1f-8497-a9c858687346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838e8a4f-3dcd-4d1f-8497-a9c858687346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ccd2fa6-80db-476d-9a81-20ef4b8269ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:28 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Volume 7a3ba8ae-607a-4855-b70d-0091b805197b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a3ba8ae-607a-4855-b70d-0091b805197b', 'volume_size': 1} Jul 10 04:39:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:28 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-6bc6f2a3-e2b9-4d20-8474-0cb015f0e634 1073741824" returned: 0 in 1.371s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-6bc6f2a3-e2b9-4d20-8474-0cb015f0e634 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:28 devstack sudo[93636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-6bc6f2a3-e2b9-4d20-8474-0cb015f0e634 Jul 10 04:39:28 devstack sudo[93636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:28 devstack sudo[93636]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-6bc6f2a3-e2b9-4d20-8474-0cb015f0e634" returned: 0 in 0.703s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] <== create_volume: return (2140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:39:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.143s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.775s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-421942709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a3ba8ae-607a-4855-b70d-0091b805197b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9010ee9668d49bba41e5b561aec5b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:28Z,use_quota=True,user_id='ce8eac92bd2742c9b0582627a8da5d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:39:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Creating volume 7a3ba8ae-607a-4855-b70d-0091b805197b {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:39:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:39:28 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:39:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d14887-2f7d-453b-be07-b763eb050f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bc6f2a3-e2b9-4d20-8474-0cb015f0e634', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:28 devstack sudo[93639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b 1073741824 Jul 10 04:39:28 devstack sudo[93639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8916b20-bcac-4223-89ae-c5eb3921be87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:28 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Volume volume-6bc6f2a3-e2b9-4d20-8474-0cb015f0e634 (6bc6f2a3-e2b9-4d20-8474-0cb015f0e634): created successfully Jul 10 04:39:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8916b20-bcac-4223-89ae-c5eb3921be87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Flow 'volume_create_manager' (1b31c7f6-cb31-4cee-9116-784aec0bb84f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:28 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d7322c01-2961-4d7f-844d-69889023432b tempest-ServersNegativeTestJSON-28224307 None] Created volume successfully. Jul 10 04:39:29 devstack sudo[93639]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b 1073741824" returned: 0 in 1.108s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:30 devstack sudo[93646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b Jul 10 04:39:30 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:30 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b" returned: 0 in 0.884s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:30 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] <== create_volume: return (2088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:39:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:30 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ccd2fa6-80db-476d-9a81-20ef4b8269ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a3ba8ae-607a-4855-b70d-0091b805197b', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:30 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149236df-602b-4f61-9626-163649f5e74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:30 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Volume volume-7a3ba8ae-607a-4855-b70d-0091b805197b (7a3ba8ae-607a-4855-b70d-0091b805197b): created successfully Jul 10 04:39:30 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149236df-602b-4f61-9626-163649f5e74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:30 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Flow 'volume_create_manager' (199dfdf6-4491-4cf1-ba7d-516038eb9e6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:30 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-7cf88ece-03c9-4da1-8077-dd4c0f41901f tempest-VolumesExtendTest-2066137391 None] Created volume successfully. Jul 10 04:39:31 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:39:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Flow 'volume_create_manager' (e31edc4c-302d-4180-8e32-f72c4ab73ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377480f5-c9d8-48bc-8779-203ebbd57148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377480f5-c9d8-48bc-8779-203ebbd57148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1928133241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6f6164-5223-45b7-9a75-4a37bb0f2768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66919765b21d420e9810a863dad633df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:31Z,use_quota=True,user_id='4754f918d9f14bc39c2ab1a29768c969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2853c390-5768-48fb-af4d-84d30cd69e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2853c390-5768-48fb-af4d-84d30cd69e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5fc353-dd77-4999-b979-c80676eb642a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5fc353-dd77-4999-b979-c80676eb642a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a6f6164-5223-45b7-9a75-4a37bb0f2768', 'volume_name': 'volume-3a6f6164-5223-45b7-9a75-4a37bb0f2768', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad14b23-63dd-4908-bd72-6b5dde79bb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad14b23-63dd-4908-bd72-6b5dde79bb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59146206-6baf-4675-b4eb-d44c11f54b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:31 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Volume 3a6f6164-5223-45b7-9a75-4a37bb0f2768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a6f6164-5223-45b7-9a75-4a37bb0f2768', 'volume_size': 1} Jul 10 04:39:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:31 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1928133241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6f6164-5223-45b7-9a75-4a37bb0f2768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66919765b21d420e9810a863dad633df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:31Z,use_quota=True,user_id='4754f918d9f14bc39c2ab1a29768c969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:39:31 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Creating volume 3a6f6164-5223-45b7-9a75-4a37bb0f2768 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:39:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:31 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:31 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:31 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:39:31 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:39:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3a6f6164-5223-45b7-9a75-4a37bb0f2768 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:31 devstack sudo[93652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3a6f6164-5223-45b7-9a75-4a37bb0f2768 1073741824 Jul 10 04:39:31 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f37ebfb3-464d-4104-8d1a-da5aa91f0955 tempest-VolumesExtendTest-2066137391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:32 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3a6f6164-5223-45b7-9a75-4a37bb0f2768 1073741824" returned: 0 in 1.001s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3a6f6164-5223-45b7-9a75-4a37bb0f2768 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:32 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3a6f6164-5223-45b7-9a75-4a37bb0f2768 Jul 10 04:39:32 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:33 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3a6f6164-5223-45b7-9a75-4a37bb0f2768" returned: 0 in 0.698s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:39:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f37ebfb3-464d-4104-8d1a-da5aa91f0955 tempest-VolumesExtendTest-2066137391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.911s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59146206-6baf-4675-b4eb-d44c11f54b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a6f6164-5223-45b7-9a75-4a37bb0f2768', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37915751-fed9-49c3-98ec-84a3c4cb8b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-f37ebfb3-464d-4104-8d1a-da5aa91f0955 tempest-VolumesExtendTest-2066137391 None] Creating offline snapshot 1ccde879-2336-4846-ad17-fbba19bd10bf of volume 7a3ba8ae-607a-4855-b70d-0091b805197b {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:39:33 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Volume volume-3a6f6164-5223-45b7-9a75-4a37bb0f2768 (3a6f6164-5223-45b7-9a75-4a37bb0f2768): created successfully Jul 10 04:39:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37915751-fed9-49c3-98ec-84a3c4cb8b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Flow 'volume_create_manager' (e31edc4c-302d-4180-8e32-f72c4ab73ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:33 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[711cfe01-3711-4bb9-a5c5-137efd04fd6d]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f37ebfb3-464d-4104-8d1a-da5aa91f0955 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:33 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-e2c56e0b-14ea-4b39-a6d1-456938b2faeb tempest-ServersNegativeTestJSON-28224307 None] Created volume successfully. Jul 10 04:39:33 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b Jul 10 04:39:33 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e61e6656-73b4-4fa8-b2ed-776afd55a751 tempest-ServersNegativeTestJSON-28224307 None] Acquiring lock "cinder-3a6f6164-5223-45b7-9a75-4a37bb0f2768-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e61e6656-73b4-4fa8-b2ed-776afd55a751 tempest-ServersNegativeTestJSON-28224307 None] Lock "cinder-3a6f6164-5223-45b7-9a75-4a37bb0f2768-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e61e6656-73b4-4fa8-b2ed-776afd55a751 tempest-ServersNegativeTestJSON-28224307 None] Acquiring lock "cinder-quobyte-3a6f6164-5223-45b7-9a75-4a37bb0f2768" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e61e6656-73b4-4fa8-b2ed-776afd55a751 tempest-ServersNegativeTestJSON-28224307 None] Lock "cinder-quobyte-3a6f6164-5223-45b7-9a75-4a37bb0f2768" acquired by "delete_volume" :: waited 0.029s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:34 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[8348a852-d7b5-4d53-af82-6cf4a1af4788]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e61e6656-73b4-4fa8-b2ed-776afd55a751 tempest-ServersNegativeTestJSON-28224307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3a6f6164-5223-45b7-9a75-4a37bb0f2768 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:34 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f37ebfb3-464d-4104-8d1a-da5aa91f0955 tempest-VolumesExtendTest-2066137391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b" returned: 0 in 0.945s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f37ebfb3-464d-4104-8d1a-da5aa91f0955 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.1ccde879-2336-4846-ad17-fbba19bd10bf 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:34 devstack sudo[93701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.1ccde879-2336-4846-ad17-fbba19bd10bf 1G Jul 10 04:39:34 devstack sudo[93701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:34 devstack sudo[93700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3a6f6164-5223-45b7-9a75-4a37bb0f2768 Jul 10 04:39:34 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:35 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e61e6656-73b4-4fa8-b2ed-776afd55a751 tempest-ServersNegativeTestJSON-28224307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3a6f6164-5223-45b7-9a75-4a37bb0f2768" returned: 0 in 0.809s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e61e6656-73b4-4fa8-b2ed-776afd55a751 tempest-ServersNegativeTestJSON-28224307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3a6f6164-5223-45b7-9a75-4a37bb0f2768 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:35 devstack sudo[93710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3a6f6164-5223-45b7-9a75-4a37bb0f2768 Jul 10 04:39:35 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:35 devstack sudo[93701]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f37ebfb3-464d-4104-8d1a-da5aa91f0955 tempest-VolumesExtendTest-2066137391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.1ccde879-2336-4846-ad17-fbba19bd10bf 1G" returned: 0 in 0.910s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f37ebfb3-464d-4104-8d1a-da5aa91f0955 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a3ba8ae-607a-4855-b70d-0091b805197b -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.1ccde879-2336-4846-ad17-fbba19bd10bf {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:35 devstack sudo[93712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a3ba8ae-607a-4855-b70d-0091b805197b -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.1ccde879-2336-4846-ad17-fbba19bd10bf Jul 10 04:39:35 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:35 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e61e6656-73b4-4fa8-b2ed-776afd55a751 tempest-ServersNegativeTestJSON-28224307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3a6f6164-5223-45b7-9a75-4a37bb0f2768" returned: 0 in 0.655s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e61e6656-73b4-4fa8-b2ed-776afd55a751 tempest-ServersNegativeTestJSON-28224307 None] Lock "cinder-quobyte-3a6f6164-5223-45b7-9a75-4a37bb0f2768" released by "delete_volume" :: held 1.514s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:35 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-e61e6656-73b4-4fa8-b2ed-776afd55a751 tempest-ServersNegativeTestJSON-28224307 None] Created reservations ['67d4ea44-6363-4e7f-9dc0-875c8e5f4afd', '7d6acfcf-c15f-4f0d-a9a0-503ff06c5172', '9e19d11d-4fe0-43d4-9fed-eee679670b38', '9301ce23-04f7-46ba-9a82-e6e1d382f9a3'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:39:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e61e6656-73b4-4fa8-b2ed-776afd55a751 tempest-ServersNegativeTestJSON-28224307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e61e6656-73b4-4fa8-b2ed-776afd55a751 tempest-ServersNegativeTestJSON-28224307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e61e6656-73b4-4fa8-b2ed-776afd55a751 tempest-ServersNegativeTestJSON-28224307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e61e6656-73b4-4fa8-b2ed-776afd55a751 tempest-ServersNegativeTestJSON-28224307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e61e6656-73b4-4fa8-b2ed-776afd55a751 tempest-ServersNegativeTestJSON-28224307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e61e6656-73b4-4fa8-b2ed-776afd55a751 tempest-ServersNegativeTestJSON-28224307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:35 devstack sudo[93718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:39:35 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:36 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f37ebfb3-464d-4104-8d1a-da5aa91f0955 tempest-VolumesExtendTest-2066137391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a3ba8ae-607a-4855-b70d-0091b805197b -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.1ccde879-2336-4846-ad17-fbba19bd10bf" returned: 0 in 0.732s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:36 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-f37ebfb3-464d-4104-8d1a-da5aa91f0955 tempest-VolumesExtendTest-2066137391 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.1ccde879-2336-4846-ad17-fbba19bd10bf is being set with open permissions: ugo+rw Jul 10 04:39:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f37ebfb3-464d-4104-8d1a-da5aa91f0955 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.1ccde879-2336-4846-ad17-fbba19bd10bf {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:36 devstack sudo[93720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.1ccde879-2336-4846-ad17-fbba19bd10bf Jul 10 04:39:36 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c5649a79-80bc-48d0-991b-51c8ac9bb12b tempest-ServersNegativeTestJSON-28224307 None] Acquiring lock "cinder-6bc6f2a3-e2b9-4d20-8474-0cb015f0e634-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c5649a79-80bc-48d0-991b-51c8ac9bb12b tempest-ServersNegativeTestJSON-28224307 None] Lock "cinder-6bc6f2a3-e2b9-4d20-8474-0cb015f0e634-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c5649a79-80bc-48d0-991b-51c8ac9bb12b tempest-ServersNegativeTestJSON-28224307 None] Acquiring lock "cinder-quobyte-6bc6f2a3-e2b9-4d20-8474-0cb015f0e634" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c5649a79-80bc-48d0-991b-51c8ac9bb12b tempest-ServersNegativeTestJSON-28224307 None] Lock "cinder-quobyte-6bc6f2a3-e2b9-4d20-8474-0cb015f0e634" acquired by "delete_volume" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:36 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[2faf92e5-3368-4433-a006-2c59e6029d4a]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c5649a79-80bc-48d0-991b-51c8ac9bb12b tempest-ServersNegativeTestJSON-28224307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-6bc6f2a3-e2b9-4d20-8474-0cb015f0e634 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:36 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e61e6656-73b4-4fa8-b2ed-776afd55a751 tempest-ServersNegativeTestJSON-28224307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.753s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:36 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-e61e6656-73b4-4fa8-b2ed-776afd55a751 tempest-ServersNegativeTestJSON-28224307 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:39:36 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-e61e6656-73b4-4fa8-b2ed-776afd55a751 tempest-ServersNegativeTestJSON-28224307 None] Deleted volume successfully. Jul 10 04:39:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e61e6656-73b4-4fa8-b2ed-776afd55a751 tempest-ServersNegativeTestJSON-28224307 None] Lock "cinder-3a6f6164-5223-45b7-9a75-4a37bb0f2768-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:36 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-6bc6f2a3-e2b9-4d20-8474-0cb015f0e634 Jul 10 04:39:36 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:36 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f37ebfb3-464d-4104-8d1a-da5aa91f0955 tempest-VolumesExtendTest-2066137391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.1ccde879-2336-4846-ad17-fbba19bd10bf" returned: 0 in 0.785s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f37ebfb3-464d-4104-8d1a-da5aa91f0955 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:36 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.info Jul 10 04:39:36 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:37 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c5649a79-80bc-48d0-991b-51c8ac9bb12b tempest-ServersNegativeTestJSON-28224307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-6bc6f2a3-e2b9-4d20-8474-0cb015f0e634" returned: 0 in 1.074s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c5649a79-80bc-48d0-991b-51c8ac9bb12b tempest-ServersNegativeTestJSON-28224307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-6bc6f2a3-e2b9-4d20-8474-0cb015f0e634 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:37 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f37ebfb3-464d-4104-8d1a-da5aa91f0955 tempest-VolumesExtendTest-2066137391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.info" returned: 0 in 0.823s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:37 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-f37ebfb3-464d-4104-8d1a-da5aa91f0955 tempest-VolumesExtendTest-2066137391 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.info is being set with open permissions: ugo+rw Jul 10 04:39:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f37ebfb3-464d-4104-8d1a-da5aa91f0955 tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:37 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-6bc6f2a3-e2b9-4d20-8474-0cb015f0e634 Jul 10 04:39:37 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:37 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.info Jul 10 04:39:37 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:38 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f37ebfb3-464d-4104-8d1a-da5aa91f0955 tempest-VolumesExtendTest-2066137391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.info" returned: 0 in 0.706s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:38 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f37ebfb3-464d-4104-8d1a-da5aa91f0955 tempest-VolumesExtendTest-2066137391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.050s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c5649a79-80bc-48d0-991b-51c8ac9bb12b tempest-ServersNegativeTestJSON-28224307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-6bc6f2a3-e2b9-4d20-8474-0cb015f0e634" returned: 0 in 0.772s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c5649a79-80bc-48d0-991b-51c8ac9bb12b tempest-ServersNegativeTestJSON-28224307 None] Lock "cinder-quobyte-6bc6f2a3-e2b9-4d20-8474-0cb015f0e634" released by "delete_volume" :: held 1.924s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:38 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-f37ebfb3-464d-4104-8d1a-da5aa91f0955 tempest-VolumesExtendTest-2066137391 None] Create snapshot completed successfully Jul 10 04:39:38 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-c5649a79-80bc-48d0-991b-51c8ac9bb12b tempest-ServersNegativeTestJSON-28224307 None] Created reservations ['2affc5e8-50fc-429e-8c04-91a9c78d66fc', 'cfcc645f-9d35-411e-becf-20a12342a6a4', '7894cc45-a46d-4733-b57a-3a414ae8c642', 'a448b87b-2a45-4279-8eb6-3edd0cb1fdd9'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:39:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c5649a79-80bc-48d0-991b-51c8ac9bb12b tempest-ServersNegativeTestJSON-28224307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c5649a79-80bc-48d0-991b-51c8ac9bb12b tempest-ServersNegativeTestJSON-28224307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:38 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c5649a79-80bc-48d0-991b-51c8ac9bb12b tempest-ServersNegativeTestJSON-28224307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:38 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c5649a79-80bc-48d0-991b-51c8ac9bb12b tempest-ServersNegativeTestJSON-28224307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c5649a79-80bc-48d0-991b-51c8ac9bb12b tempest-ServersNegativeTestJSON-28224307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c5649a79-80bc-48d0-991b-51c8ac9bb12b tempest-ServersNegativeTestJSON-28224307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:38 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:39:38 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-65fb89ac-a844-4e55-9e9a-a5ddb4381e1d tempest-VolumesExtendTest-2066137391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-65fb89ac-a844-4e55-9e9a-a5ddb4381e1d tempest-VolumesExtendTest-2066137391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:39 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4051ea4-dbe9-4011-999a-ca6b7af17268]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-65fb89ac-a844-4e55-9e9a-a5ddb4381e1d tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:39 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b Jul 10 04:39:39 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:39 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c5649a79-80bc-48d0-991b-51c8ac9bb12b tempest-ServersNegativeTestJSON-28224307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.868s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:39 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-c5649a79-80bc-48d0-991b-51c8ac9bb12b tempest-ServersNegativeTestJSON-28224307 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:39:39 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c5649a79-80bc-48d0-991b-51c8ac9bb12b tempest-ServersNegativeTestJSON-28224307 None] Deleted volume successfully. Jul 10 04:39:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c5649a79-80bc-48d0-991b-51c8ac9bb12b tempest-ServersNegativeTestJSON-28224307 None] Lock "cinder-6bc6f2a3-e2b9-4d20-8474-0cb015f0e634-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:39 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-65fb89ac-a844-4e55-9e9a-a5ddb4381e1d tempest-VolumesExtendTest-2066137391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b" returned: 0 in 0.843s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-65fb89ac-a844-4e55-9e9a-a5ddb4381e1d tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.1ccde879-2336-4846-ad17-fbba19bd10bf 2G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-65fb89ac-a844-4e55-9e9a-a5ddb4381e1d tempest-VolumesExtendTest-2066137391 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.1ccde879-2336-4846-ad17-fbba19bd10bf 2G" returned: 0 in 0.148s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-65fb89ac-a844-4e55-9e9a-a5ddb4381e1d tempest-VolumesExtendTest-2066137391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.048s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:40 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-65fb89ac-a844-4e55-9e9a-a5ddb4381e1d tempest-VolumesExtendTest-2066137391 None] Extend volume completed successfully. Jul 10 04:39:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-28fd4f3c-7ccf-429a-9cc4-217278a40b9b tempest-VolumesExtendTest-2066137391 None] Acquiring lock "cinder-1ccde879-2336-4846-ad17-fbba19bd10bf-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-28fd4f3c-7ccf-429a-9cc4-217278a40b9b tempest-VolumesExtendTest-2066137391 None] Lock "cinder-1ccde879-2336-4846-ad17-fbba19bd10bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-28fd4f3c-7ccf-429a-9cc4-217278a40b9b tempest-VolumesExtendTest-2066137391 None] Acquiring lock "cinder-quobyte-7a3ba8ae-607a-4855-b70d-0091b805197b" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-28fd4f3c-7ccf-429a-9cc4-217278a40b9b tempest-VolumesExtendTest-2066137391 None] Lock "cinder-quobyte-7a3ba8ae-607a-4855-b70d-0091b805197b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-28fd4f3c-7ccf-429a-9cc4-217278a40b9b tempest-VolumesExtendTest-2066137391 None] Acquiring lock "cinder-quobyte-1ccde879-2336-4846-ad17-fbba19bd10bf" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-28fd4f3c-7ccf-429a-9cc4-217278a40b9b tempest-VolumesExtendTest-2066137391 None] Lock "cinder-quobyte-1ccde879-2336-4846-ad17-fbba19bd10bf" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-28fd4f3c-7ccf-429a-9cc4-217278a40b9b tempest-VolumesExtendTest-2066137391 None] Deleting offline snapshot 1ccde879-2336-4846-ad17-fbba19bd10bf of volume 7a3ba8ae-607a-4855-b70d-0091b805197b {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:39:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-28fd4f3c-7ccf-429a-9cc4-217278a40b9b tempest-VolumesExtendTest-2066137391 None] snapshot_file for this snap is: volume-7a3ba8ae-607a-4855-b70d-0091b805197b.1ccde879-2336-4846-ad17-fbba19bd10bf {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:39:41 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[020c9dca-0529-43c7-a139-0fe481242263]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-28fd4f3c-7ccf-429a-9cc4-217278a40b9b tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.1ccde879-2336-4846-ad17-fbba19bd10bf {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:41 devstack sudo[93795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.1ccde879-2336-4846-ad17-fbba19bd10bf Jul 10 04:39:41 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:42 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-28fd4f3c-7ccf-429a-9cc4-217278a40b9b tempest-VolumesExtendTest-2066137391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.1ccde879-2336-4846-ad17-fbba19bd10bf" returned: 0 in 1.050s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-28fd4f3c-7ccf-429a-9cc4-217278a40b9b tempest-VolumesExtendTest-2066137391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a3ba8ae-607a-4855-b70d-0091b805197b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:39:42 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[830e271a-5dd1-444f-8b55-078b12e775a1]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-28fd4f3c-7ccf-429a-9cc4-217278a40b9b tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:42 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b Jul 10 04:39:42 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:43 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-28fd4f3c-7ccf-429a-9cc4-217278a40b9b tempest-VolumesExtendTest-2066137391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b" returned: 0 in 0.884s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-28fd4f3c-7ccf-429a-9cc4-217278a40b9b tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.1ccde879-2336-4846-ad17-fbba19bd10bf {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:43 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.1ccde879-2336-4846-ad17-fbba19bd10bf Jul 10 04:39:43 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:44 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-28fd4f3c-7ccf-429a-9cc4-217278a40b9b tempest-VolumesExtendTest-2066137391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.1ccde879-2336-4846-ad17-fbba19bd10bf" returned: 0 in 0.871s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-28fd4f3c-7ccf-429a-9cc4-217278a40b9b tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.1ccde879-2336-4846-ad17-fbba19bd10bf {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:44 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.1ccde879-2336-4846-ad17-fbba19bd10bf Jul 10 04:39:44 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:45 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-28fd4f3c-7ccf-429a-9cc4-217278a40b9b tempest-VolumesExtendTest-2066137391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b.1ccde879-2336-4846-ad17-fbba19bd10bf" returned: 0 in 0.699s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:45 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-28fd4f3c-7ccf-429a-9cc4-217278a40b9b tempest-VolumesExtendTest-2066137391 None] Lock "cinder-quobyte-1ccde879-2336-4846-ad17-fbba19bd10bf" released by "_delete_snapshot" :: held 3.704s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:45 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-28fd4f3c-7ccf-429a-9cc4-217278a40b9b tempest-VolumesExtendTest-2066137391 None] Lock "cinder-quobyte-7a3ba8ae-607a-4855-b70d-0091b805197b" released by "delete_snapshot" :: held 3.743s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:45 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-28fd4f3c-7ccf-429a-9cc4-217278a40b9b tempest-VolumesExtendTest-2066137391 None] Created reservations ['5311d593-dd57-46e2-bb80-e33dc9507ffd', '31ff1151-bd8c-4f10-a983-561f73f0ef31', '4f548386-14db-4919-add0-afa5a9a47ba5', '5ac56b68-15df-4062-9c82-771b5dc2c82b'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:39:45 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-28fd4f3c-7ccf-429a-9cc4-217278a40b9b tempest-VolumesExtendTest-2066137391 None] Delete snapshot completed successfully. Jul 10 04:39:45 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-28fd4f3c-7ccf-429a-9cc4-217278a40b9b tempest-VolumesExtendTest-2066137391 None] Lock "cinder-1ccde879-2336-4846-ad17-fbba19bd10bf-delete_snapshot" released by "delete_snapshot" :: held 3.953s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:45 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3b5ef142-eed8-4ebe-a356-a9efb15ae5fb tempest-VolumesExtendTest-2066137391 None] Acquiring lock "cinder-7a3ba8ae-607a-4855-b70d-0091b805197b-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:45 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3b5ef142-eed8-4ebe-a356-a9efb15ae5fb tempest-VolumesExtendTest-2066137391 None] Lock "cinder-7a3ba8ae-607a-4855-b70d-0091b805197b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:45 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3b5ef142-eed8-4ebe-a356-a9efb15ae5fb tempest-VolumesExtendTest-2066137391 None] Acquiring lock "cinder-quobyte-7a3ba8ae-607a-4855-b70d-0091b805197b" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:45 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:39:45 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Flow 'volume_create_manager' (f64451a2-e564-4225-b8fb-eeb454228f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:45 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51251b21-b5a4-41e5-b10b-5ed8b3544a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:45 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51251b21-b5a4-41e5-b10b-5ed8b3544a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1688243337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392efb54-a921-4a6c-a638-0dc96a80c0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15411bf75a4c478c989ad988097dbdfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:46Z,use_quota=True,user_id='63f87044dc3342b1abe652a0b60f6d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:45 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0afca39-cb9c-4413-a736-25f71d9da73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:45 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0afca39-cb9c-4413-a736-25f71d9da73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:46 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2fe48e4-e2f5-439f-869a-385f8e3568ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:46 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2fe48e4-e2f5-439f-869a-385f8e3568ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '392efb54-a921-4a6c-a638-0dc96a80c0b2', 'volume_name': 'volume-392efb54-a921-4a6c-a638-0dc96a80c0b2', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:46 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10343d8-a470-45eb-bf4e-0f5e5f14e7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:46 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10343d8-a470-45eb-bf4e-0f5e5f14e7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:46 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ad19c5-88df-411b-8d15-21407b0c983e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:46 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Volume 392efb54-a921-4a6c-a638-0dc96a80c0b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-392efb54-a921-4a6c-a638-0dc96a80c0b2', 'volume_size': 1} Jul 10 04:39:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1688243337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392efb54-a921-4a6c-a638-0dc96a80c0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15411bf75a4c478c989ad988097dbdfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:46Z,use_quota=True,user_id='63f87044dc3342b1abe652a0b60f6d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:39:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Creating volume 392efb54-a921-4a6c-a638-0dc96a80c0b2 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:39:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:39:46 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:39:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392efb54-a921-4a6c-a638-0dc96a80c0b2 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:46 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3b5ef142-eed8-4ebe-a356-a9efb15ae5fb tempest-VolumesExtendTest-2066137391 None] Lock "cinder-quobyte-7a3ba8ae-607a-4855-b70d-0091b805197b" acquired by "delete_volume" :: waited 0.121s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:46 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392efb54-a921-4a6c-a638-0dc96a80c0b2 1073741824 Jul 10 04:39:46 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:46 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d0795d-66a0-46e2-9abf-6fca93901cab]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3b5ef142-eed8-4ebe-a356-a9efb15ae5fb tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:46 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b Jul 10 04:39:46 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:47 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3b5ef142-eed8-4ebe-a356-a9efb15ae5fb tempest-VolumesExtendTest-2066137391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b" returned: 0 in 1.081s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3b5ef142-eed8-4ebe-a356-a9efb15ae5fb tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:47 devstack sudo[93899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b Jul 10 04:39:47 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:47 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392efb54-a921-4a6c-a638-0dc96a80c0b2 1073741824" returned: 0 in 1.252s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392efb54-a921-4a6c-a638-0dc96a80c0b2 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:47 devstack sudo[93901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392efb54-a921-4a6c-a638-0dc96a80c0b2 Jul 10 04:39:47 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Flow 'volume_create_manager' (be872d3d-d1b8-4970-aa02-fb53bc4419b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e36631-4b73-4d75-a646-e57a913daf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e36631-4b73-4d75-a646-e57a913daf1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1378802648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9428ee-6576-49fd-933b-2aa910cadd95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7752e6aa52545c7bc894514fbea66b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:48Z,use_quota=True,user_id='cf021302156d45c0a5d572495bc055ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9a2d31-32ae-4504-b609-7bbb8c19461b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9a2d31-32ae-4504-b609-7bbb8c19461b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e4e4d4-c4ad-45c8-9dd5-f5ae917cae55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e4e4d4-c4ad-45c8-9dd5-f5ae917cae55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b9428ee-6576-49fd-933b-2aa910cadd95', 'volume_name': 'volume-9b9428ee-6576-49fd-933b-2aa910cadd95', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cfeb6c-2afa-448e-abf4-6f7fd1bd9bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cfeb6c-2afa-448e-abf4-6f7fd1bd9bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93ae056-0bed-4c62-9972-b5d9ac3d0075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:48 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Volume 9b9428ee-6576-49fd-933b-2aa910cadd95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b9428ee-6576-49fd-933b-2aa910cadd95', 'volume_size': 1} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:48 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3b5ef142-eed8-4ebe-a356-a9efb15ae5fb tempest-VolumesExtendTest-2066137391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7a3ba8ae-607a-4855-b70d-0091b805197b" returned: 0 in 1.239s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:48 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392efb54-a921-4a6c-a638-0dc96a80c0b2" returned: 0 in 1.083s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] <== create_volume: return (2417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.421s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3b5ef142-eed8-4ebe-a356-a9efb15ae5fb tempest-VolumesExtendTest-2066137391 None] Lock "cinder-quobyte-7a3ba8ae-607a-4855-b70d-0091b805197b" released by "delete_volume" :: held 2.404s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.086s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1378802648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9428ee-6576-49fd-933b-2aa910cadd95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7752e6aa52545c7bc894514fbea66b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:48Z,use_quota=True,user_id='cf021302156d45c0a5d572495bc055ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Creating volume 9b9428ee-6576-49fd-933b-2aa910cadd95 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:39:48 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9b9428ee-6576-49fd-933b-2aa910cadd95 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ad19c5-88df-411b-8d15-21407b0c983e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-392efb54-a921-4a6c-a638-0dc96a80c0b2', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:48 devstack sudo[93905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9b9428ee-6576-49fd-933b-2aa910cadd95 1073741824 Jul 10 04:39:48 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16475250-3363-467a-ae56-93dcd7fd25cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:48 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Volume volume-392efb54-a921-4a6c-a638-0dc96a80c0b2 (392efb54-a921-4a6c-a638-0dc96a80c0b2): created successfully Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16475250-3363-467a-ae56-93dcd7fd25cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Flow 'volume_create_manager' (f64451a2-e564-4225-b8fb-eeb454228f5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:48 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-760463f5-72e9-438d-ae97-3edbf161a24a tempest-AttachVolumeNegativeTest-351970016 None] Created volume successfully. Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-3b5ef142-eed8-4ebe-a356-a9efb15ae5fb tempest-VolumesExtendTest-2066137391 None] Created reservations ['ca7c9fe0-f846-497d-ba21-20e5f9ac420a', '8d96e0b9-49db-4e25-8f2c-ae837fef6f08', 'c3b7bc4a-c495-4889-9861-97cb588c0d9c', '189ed22a-8206-4d8e-af80-c2c843275c2d'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3b5ef142-eed8-4ebe-a356-a9efb15ae5fb tempest-VolumesExtendTest-2066137391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3b5ef142-eed8-4ebe-a356-a9efb15ae5fb tempest-VolumesExtendTest-2066137391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3b5ef142-eed8-4ebe-a356-a9efb15ae5fb tempest-VolumesExtendTest-2066137391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3b5ef142-eed8-4ebe-a356-a9efb15ae5fb tempest-VolumesExtendTest-2066137391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3b5ef142-eed8-4ebe-a356-a9efb15ae5fb tempest-VolumesExtendTest-2066137391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3b5ef142-eed8-4ebe-a356-a9efb15ae5fb tempest-VolumesExtendTest-2066137391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:48 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:39:48 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:49 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3b5ef142-eed8-4ebe-a356-a9efb15ae5fb tempest-VolumesExtendTest-2066137391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.863s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:49 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-3b5ef142-eed8-4ebe-a356-a9efb15ae5fb tempest-VolumesExtendTest-2066137391 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:39:49 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-3b5ef142-eed8-4ebe-a356-a9efb15ae5fb tempest-VolumesExtendTest-2066137391 None] Deleted volume successfully. Jul 10 04:39:49 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3b5ef142-eed8-4ebe-a356-a9efb15ae5fb tempest-VolumesExtendTest-2066137391 None] Lock "cinder-7a3ba8ae-607a-4855-b70d-0091b805197b-delete_volume" released by "delete_volume" :: held 3.748s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:49 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9b9428ee-6576-49fd-933b-2aa910cadd95 1073741824" returned: 0 in 1.395s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9b9428ee-6576-49fd-933b-2aa910cadd95 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:49 devstack sudo[93919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9b9428ee-6576-49fd-933b-2aa910cadd95 Jul 10 04:39:49 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:50 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9b9428ee-6576-49fd-933b-2aa910cadd95" returned: 0 in 0.758s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] <== create_volume: return (2207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:39:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.211s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93ae056-0bed-4c62-9972-b5d9ac3d0075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b9428ee-6576-49fd-933b-2aa910cadd95', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbdce4f-20d1-4252-a5ce-46613997593a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:50 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Volume volume-9b9428ee-6576-49fd-933b-2aa910cadd95 (9b9428ee-6576-49fd-933b-2aa910cadd95): created successfully Jul 10 04:39:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbdce4f-20d1-4252-a5ce-46613997593a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Flow 'volume_create_manager' (be872d3d-d1b8-4970-aa02-fb53bc4419b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:50 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ffdb26b6-5dce-411d-9436-eecd922d4764 tempest-VolumesActionsTest-1152699420 None] Created volume successfully. Jul 10 04:39:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a6287e31-0790-4fd0-b09d-440ce1607772 tempest-VolumesActionsTest-1152699420 None] Acquiring lock "cinder-9b9428ee-6576-49fd-933b-2aa910cadd95" by "attach_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a6287e31-0790-4fd0-b09d-440ce1607772 tempest-VolumesActionsTest-1152699420 None] Lock "cinder-9b9428ee-6576-49fd-933b-2aa910cadd95" acquired by "attach_volume" :: waited 0.030s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:51 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a6287e31-0790-4fd0-b09d-440ce1607772 tempest-VolumesActionsTest-1152699420 None] Attaching volume 9b9428ee-6576-49fd-933b-2aa910cadd95 to instance 710b43cf-5270-43b3-b6d5-ca9423660414 at mountpoint /dev/vdb on host None. Jul 10 04:39:51 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a6287e31-0790-4fd0-b09d-440ce1607772 tempest-VolumesActionsTest-1152699420 None] Attach volume completed successfully. Jul 10 04:39:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a6287e31-0790-4fd0-b09d-440ce1607772 tempest-VolumesActionsTest-1152699420 None] Lock "cinder-9b9428ee-6576-49fd-933b-2aa910cadd95" released by "attach_volume" :: held 0.191s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:52 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-5c4a03d0-2fb2-48a4-b6d0-780967aeb4c0 tempest-VolumesActionsTest-1968637615 None] Terminate volume connection completed successfully. Jul 10 04:39:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5c4a03d0-2fb2-48a4-b6d0-780967aeb4c0 tempest-VolumesActionsTest-1968637615 None] Acquiring lock "cinder-9b9428ee-6576-49fd-933b-2aa910cadd95-detach_volume" by "detach_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5c4a03d0-2fb2-48a4-b6d0-780967aeb4c0 tempest-VolumesActionsTest-1968637615 None] Lock "cinder-9b9428ee-6576-49fd-933b-2aa910cadd95-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:53 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-5c4a03d0-2fb2-48a4-b6d0-780967aeb4c0 tempest-VolumesActionsTest-1968637615 None] Detaching volume 9b9428ee-6576-49fd-933b-2aa910cadd95 from instance 710b43cf-5270-43b3-b6d5-ca9423660414. Jul 10 04:39:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-74981a18-7e67-43af-be79-2a42b62ef3d2 req-919c40ce-5eaa-4df1-829c-9fbf9f14050c tempest-AttachVolumeNegativeTest-351970016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-74981a18-7e67-43af-be79-2a42b62ef3d2 req-919c40ce-5eaa-4df1-829c-9fbf9f14050c tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:53 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-5c4a03d0-2fb2-48a4-b6d0-780967aeb4c0 tempest-VolumesActionsTest-1968637615 None] Detach volume completed successfully. Jul 10 04:39:53 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[5064143a-1766-4608-9ee8-4cbd2381a6e6]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-74981a18-7e67-43af-be79-2a42b62ef3d2 req-919c40ce-5eaa-4df1-829c-9fbf9f14050c tempest-AttachVolumeNegativeTest-351970016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392efb54-a921-4a6c-a638-0dc96a80c0b2 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5c4a03d0-2fb2-48a4-b6d0-780967aeb4c0 tempest-VolumesActionsTest-1968637615 None] Lock "cinder-9b9428ee-6576-49fd-933b-2aa910cadd95-detach_volume" released by "detach_volume" :: held 0.179s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:53 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392efb54-a921-4a6c-a638-0dc96a80c0b2 Jul 10 04:39:53 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8efedd0c-7285-41c6-a90d-a702f839fd9b tempest-VolumesActionsTest-1152699420 None] Acquiring lock "cinder-9b9428ee-6576-49fd-933b-2aa910cadd95-detach_volume" by "detach_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8efedd0c-7285-41c6-a90d-a702f839fd9b tempest-VolumesActionsTest-1152699420 None] Lock "cinder-9b9428ee-6576-49fd-933b-2aa910cadd95-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:54 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-8efedd0c-7285-41c6-a90d-a702f839fd9b tempest-VolumesActionsTest-1152699420 None] Volume detach called, but volume not attached. Jul 10 04:39:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8efedd0c-7285-41c6-a90d-a702f839fd9b tempest-VolumesActionsTest-1152699420 None] Lock "cinder-9b9428ee-6576-49fd-933b-2aa910cadd95-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:54 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-74981a18-7e67-43af-be79-2a42b62ef3d2 req-919c40ce-5eaa-4df1-829c-9fbf9f14050c tempest-AttachVolumeNegativeTest-351970016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392efb54-a921-4a6c-a638-0dc96a80c0b2" returned: 0 in 1.214s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-74981a18-7e67-43af-be79-2a42b62ef3d2 req-919c40ce-5eaa-4df1-829c-9fbf9f14050c tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.258s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-74981a18-7e67-43af-be79-2a42b62ef3d2 req-919c40ce-5eaa-4df1-829c-9fbf9f14050c tempest-AttachVolumeNegativeTest-351970016 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31', 'name': 'volume-392efb54-a921-4a6c-a638-0dc96a80c0b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '080839de-91fc-4e72-9f8d-35bca6169039', 'enforce_multipath': True} {{(pid=87359) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4975}} Jul 10 04:39:54 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-74981a18-7e67-43af-be79-2a42b62ef3d2 req-919c40ce-5eaa-4df1-829c-9fbf9f14050c tempest-AttachVolumeNegativeTest-351970016 None] attachment_update completed successfully. Jul 10 04:39:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-302150c5-be44-4550-8c20-564c80070242 tempest-VolumesActionsTest-1152699420 None] Acquiring lock "cinder-9b9428ee-6576-49fd-933b-2aa910cadd95-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-302150c5-be44-4550-8c20-564c80070242 tempest-VolumesActionsTest-1152699420 None] Lock "cinder-9b9428ee-6576-49fd-933b-2aa910cadd95-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-302150c5-be44-4550-8c20-564c80070242 tempest-VolumesActionsTest-1152699420 None] Acquiring lock "cinder-quobyte-9b9428ee-6576-49fd-933b-2aa910cadd95" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-302150c5-be44-4550-8c20-564c80070242 tempest-VolumesActionsTest-1152699420 None] Lock "cinder-quobyte-9b9428ee-6576-49fd-933b-2aa910cadd95" acquired by "delete_volume" :: waited 0.048s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:55 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b4059f-7786-4144-8ec1-98b2d4822816]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-302150c5-be44-4550-8c20-564c80070242 tempest-VolumesActionsTest-1152699420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9b9428ee-6576-49fd-933b-2aa910cadd95 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:55 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9b9428ee-6576-49fd-933b-2aa910cadd95 Jul 10 04:39:55 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:56 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-302150c5-be44-4550-8c20-564c80070242 tempest-VolumesActionsTest-1152699420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9b9428ee-6576-49fd-933b-2aa910cadd95" returned: 0 in 1.275s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-302150c5-be44-4550-8c20-564c80070242 tempest-VolumesActionsTest-1152699420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9b9428ee-6576-49fd-933b-2aa910cadd95 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:56 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9b9428ee-6576-49fd-933b-2aa910cadd95 Jul 10 04:39:56 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:57 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-302150c5-be44-4550-8c20-564c80070242 tempest-VolumesActionsTest-1152699420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9b9428ee-6576-49fd-933b-2aa910cadd95" returned: 0 in 1.043s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-302150c5-be44-4550-8c20-564c80070242 tempest-VolumesActionsTest-1152699420 None] Lock "cinder-quobyte-9b9428ee-6576-49fd-933b-2aa910cadd95" released by "delete_volume" :: held 2.375s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:57 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-302150c5-be44-4550-8c20-564c80070242 tempest-VolumesActionsTest-1152699420 None] Created reservations ['d21f103e-c56d-4e45-9631-9bcf0afa4e11', 'dcddefa8-5526-4f44-ac8d-b191b7d30d59', '3fe7f16a-ddd3-43d8-b915-e0ffaf5d05ec', 'e0a50644-d2e3-4a06-b5c1-8d36631adaac'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:39:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-302150c5-be44-4550-8c20-564c80070242 tempest-VolumesActionsTest-1152699420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-302150c5-be44-4550-8c20-564c80070242 tempest-VolumesActionsTest-1152699420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-302150c5-be44-4550-8c20-564c80070242 tempest-VolumesActionsTest-1152699420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-302150c5-be44-4550-8c20-564c80070242 tempest-VolumesActionsTest-1152699420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-302150c5-be44-4550-8c20-564c80070242 tempest-VolumesActionsTest-1152699420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-302150c5-be44-4550-8c20-564c80070242 tempest-VolumesActionsTest-1152699420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:58 devstack sudo[94388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:39:58 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:59 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-302150c5-be44-4550-8c20-564c80070242 tempest-VolumesActionsTest-1152699420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.137s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:59 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-302150c5-be44-4550-8c20-564c80070242 tempest-VolumesActionsTest-1152699420 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:39:59 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-302150c5-be44-4550-8c20-564c80070242 tempest-VolumesActionsTest-1152699420 None] Deleted volume successfully. Jul 10 04:39:59 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-302150c5-be44-4550-8c20-564c80070242 tempest-VolumesActionsTest-1152699420 None] Lock "cinder-9b9428ee-6576-49fd-933b-2aa910cadd95-delete_volume" released by "delete_volume" :: held 3.980s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:01 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-9a29bc93-bf17-4a48-b295-257add3627f6 req-5f994c26-1ce7-45cf-b116-fc64b7483aed tempest-AttachVolumeNegativeTest-351970016 None] Terminate volume connection completed successfully. Jul 10 04:40:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-9a29bc93-bf17-4a48-b295-257add3627f6 req-5f994c26-1ce7-45cf-b116-fc64b7483aed tempest-AttachVolumeNegativeTest-351970016 None] Deleting attachment 080839de-91fc-4e72-9f8d-35bca6169039. {{(pid=87359) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5106}} Jul 10 04:40:10 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=73,cinder:INSERT=24,cinder:UPDATE=77,cinder:DELETE=9 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:40:11 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=72,cinder:SELECT=63,cinder:INSERT=20,cinder:DELETE=3 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:40:11 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:40:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Flow 'volume_create_manager' (27d9ac05-8c91-4ec7-b38a-56ae6341790f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce60b47-512d-4d9b-916b-f3a39f36c39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce60b47-512d-4d9b-916b-f3a39f36c39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1079456019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7752e6aa52545c7bc894514fbea66b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:12Z,use_quota=True,user_id='cf021302156d45c0a5d572495bc055ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1481ecaf-3cde-4753-8792-b22b846f3d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1481ecaf-3cde-4753-8792-b22b846f3d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6c3fd9-4476-432f-adc4-584aa1a1bca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6c3fd9-4476-432f-adc4-584aa1a1bca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b', 'volume_name': 'volume-8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d13c1c96-1c42-4464-b6c8-e285944d340d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d13c1c96-1c42-4464-b6c8-e285944d340d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5dac84-19cb-4d33-af4d-18ea3003b933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:12 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Volume 8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b', 'volume_size': 1} Jul 10 04:40:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1079456019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7752e6aa52545c7bc894514fbea66b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:12Z,use_quota=True,user_id='cf021302156d45c0a5d572495bc055ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:40:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Creating volume 8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:40:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:40:12 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:40:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:12 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b 1073741824 Jul 10 04:40:12 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:13 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b 1073741824" returned: 0 in 1.279s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:13 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b Jul 10 04:40:13 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:14 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b" returned: 0 in 1.226s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] <== create_volume: return (2565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:40:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.571s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5dac84-19cb-4d33-af4d-18ea3003b933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489d05c0-5aeb-4577-8581-799b08175ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:14 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Volume volume-8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b (8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b): created successfully Jul 10 04:40:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489d05c0-5aeb-4577-8581-799b08175ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Flow 'volume_create_manager' (27d9ac05-8c91-4ec7-b38a-56ae6341790f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:14 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-46855e66-f863-4a0d-abb4-22a19825d5c5 tempest-VolumesActionsTest-1152699420 None] Created volume successfully. Jul 10 04:40:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-40537a17-1bb6-4a8e-9d6b-42ccdf5c17dd tempest-VolumesActionsTest-1968637615 None] Acquiring lock "cinder-8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-40537a17-1bb6-4a8e-9d6b-42ccdf5c17dd tempest-VolumesActionsTest-1968637615 None] Lock "cinder-8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-40537a17-1bb6-4a8e-9d6b-42ccdf5c17dd tempest-VolumesActionsTest-1968637615 None] Acquiring lock "cinder-quobyte-8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-40537a17-1bb6-4a8e-9d6b-42ccdf5c17dd tempest-VolumesActionsTest-1968637615 None] Lock "cinder-quobyte-8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b" acquired by "delete_volume" :: waited 0.022s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:15 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e44c6a9-76dd-49a7-bcd7-44a27c0c02ea]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-40537a17-1bb6-4a8e-9d6b-42ccdf5c17dd tempest-VolumesActionsTest-1968637615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:15 devstack sudo[94498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b Jul 10 04:40:15 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:40:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:15 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:40:15 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:16 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3ff1a2dc-2d3a-4015-a002-72a224e6c332 tempest-AttachVolumeNegativeTest-351970016 None] Acquiring lock "cinder-392efb54-a921-4a6c-a638-0dc96a80c0b2-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:16 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3ff1a2dc-2d3a-4015-a002-72a224e6c332 tempest-AttachVolumeNegativeTest-351970016 None] Lock "cinder-392efb54-a921-4a6c-a638-0dc96a80c0b2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:16 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3ff1a2dc-2d3a-4015-a002-72a224e6c332 tempest-AttachVolumeNegativeTest-351970016 None] Acquiring lock "cinder-quobyte-392efb54-a921-4a6c-a638-0dc96a80c0b2" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:16 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3ff1a2dc-2d3a-4015-a002-72a224e6c332 tempest-AttachVolumeNegativeTest-351970016 None] Lock "cinder-quobyte-392efb54-a921-4a6c-a638-0dc96a80c0b2" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:16 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[79df6f6c-47dc-4d43-ab71-2bfd21b67564]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3ff1a2dc-2d3a-4015-a002-72a224e6c332 tempest-AttachVolumeNegativeTest-351970016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392efb54-a921-4a6c-a638-0dc96a80c0b2 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:16 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392efb54-a921-4a6c-a638-0dc96a80c0b2 Jul 10 04:40:16 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:16 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-40537a17-1bb6-4a8e-9d6b-42ccdf5c17dd tempest-VolumesActionsTest-1968637615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b" returned: 0 in 0.971s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-40537a17-1bb6-4a8e-9d6b-42ccdf5c17dd tempest-VolumesActionsTest-1968637615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:16 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b Jul 10 04:40:16 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:16 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.966s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:40:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:40:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:40:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:40:17 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3ff1a2dc-2d3a-4015-a002-72a224e6c332 tempest-AttachVolumeNegativeTest-351970016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392efb54-a921-4a6c-a638-0dc96a80c0b2" returned: 0 in 1.028s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3ff1a2dc-2d3a-4015-a002-72a224e6c332 tempest-AttachVolumeNegativeTest-351970016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392efb54-a921-4a6c-a638-0dc96a80c0b2 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:17 devstack sudo[94516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392efb54-a921-4a6c-a638-0dc96a80c0b2 Jul 10 04:40:17 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:17 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-40537a17-1bb6-4a8e-9d6b-42ccdf5c17dd tempest-VolumesActionsTest-1968637615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b" returned: 0 in 0.945s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:17 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-40537a17-1bb6-4a8e-9d6b-42ccdf5c17dd tempest-VolumesActionsTest-1968637615 None] Lock "cinder-quobyte-8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b" released by "delete_volume" :: held 1.974s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:17 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-40537a17-1bb6-4a8e-9d6b-42ccdf5c17dd tempest-VolumesActionsTest-1968637615 None] Created reservations ['85c983ef-a1c7-421a-8f04-ae3e5148248c', '7a992706-17a7-428e-b914-e680497b16f8', 'a39be7be-fccf-4eae-b758-913c4e2edf4d', '9edd8212-b42d-447e-9110-cc233d37c35e'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-40537a17-1bb6-4a8e-9d6b-42ccdf5c17dd tempest-VolumesActionsTest-1968637615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-40537a17-1bb6-4a8e-9d6b-42ccdf5c17dd tempest-VolumesActionsTest-1968637615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-40537a17-1bb6-4a8e-9d6b-42ccdf5c17dd tempest-VolumesActionsTest-1968637615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-40537a17-1bb6-4a8e-9d6b-42ccdf5c17dd tempest-VolumesActionsTest-1968637615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-40537a17-1bb6-4a8e-9d6b-42ccdf5c17dd tempest-VolumesActionsTest-1968637615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-40537a17-1bb6-4a8e-9d6b-42ccdf5c17dd tempest-VolumesActionsTest-1968637615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:17 devstack sudo[94520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:40:17 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:18 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3ff1a2dc-2d3a-4015-a002-72a224e6c332 tempest-AttachVolumeNegativeTest-351970016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392efb54-a921-4a6c-a638-0dc96a80c0b2" returned: 0 in 0.789s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3ff1a2dc-2d3a-4015-a002-72a224e6c332 tempest-AttachVolumeNegativeTest-351970016 None] Lock "cinder-quobyte-392efb54-a921-4a6c-a638-0dc96a80c0b2" released by "delete_volume" :: held 1.892s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-3ff1a2dc-2d3a-4015-a002-72a224e6c332 tempest-AttachVolumeNegativeTest-351970016 None] Created reservations ['2c9dd358-418e-4ba9-a0aa-cebbd7edb313', 'a90168de-046c-429b-910d-f45a447acd38', '3e1614b7-90e3-45bc-8788-8fa00e8c9f95', '612c40ec-c93a-4228-b3c0-a25efd40729e'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3ff1a2dc-2d3a-4015-a002-72a224e6c332 tempest-AttachVolumeNegativeTest-351970016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3ff1a2dc-2d3a-4015-a002-72a224e6c332 tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1a2dc-2d3a-4015-a002-72a224e6c332 tempest-AttachVolumeNegativeTest-351970016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1a2dc-2d3a-4015-a002-72a224e6c332 tempest-AttachVolumeNegativeTest-351970016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3ff1a2dc-2d3a-4015-a002-72a224e6c332 tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3ff1a2dc-2d3a-4015-a002-72a224e6c332 tempest-AttachVolumeNegativeTest-351970016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:18 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:40:18 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:18 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-40537a17-1bb6-4a8e-9d6b-42ccdf5c17dd tempest-VolumesActionsTest-1968637615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.862s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-40537a17-1bb6-4a8e-9d6b-42ccdf5c17dd tempest-VolumesActionsTest-1968637615 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:40:18 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-40537a17-1bb6-4a8e-9d6b-42ccdf5c17dd tempest-VolumesActionsTest-1968637615 None] Deleted volume successfully. Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-40537a17-1bb6-4a8e-9d6b-42ccdf5c17dd tempest-VolumesActionsTest-1968637615 None] Lock "cinder-8cfaee4c-3c4f-4e44-8a56-b3d63e0f666b-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c698e77c-d4ed-45bf-8094-6a9ae8640d42 tempest-AttachVolumeNegativeTest-351970016 None] Acquiring lock "cinder-f3a3e202-0fc6-44b1-a86f-61dcac851e8b-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c698e77c-d4ed-45bf-8094-6a9ae8640d42 tempest-AttachVolumeNegativeTest-351970016 None] Lock "cinder-f3a3e202-0fc6-44b1-a86f-61dcac851e8b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Flow 'volume_create_manager' (1d1ba4ff-9ec8-4dff-95f6-eaaa4df16b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ed9819-f53a-4295-8823-2dc226ae6f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ed9819-f53a-4295-8823-2dc226ae6f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-115478398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb28581-edfb-4ac7-850d-2d2d937eaa91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7752e6aa52545c7bc894514fbea66b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:19Z,use_quota=True,user_id='cf021302156d45c0a5d572495bc055ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831bcd7e-f97d-4f22-b2a3-61a2443b4b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831bcd7e-f97d-4f22-b2a3-61a2443b4b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77cc5e82-36c7-4331-bf1e-a9284231f0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77cc5e82-36c7-4331-bf1e-a9284231f0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cb28581-edfb-4ac7-850d-2d2d937eaa91', 'volume_name': 'volume-0cb28581-edfb-4ac7-850d-2d2d937eaa91', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f580fe-e611-4d1e-822f-d9c33bd9283d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f580fe-e611-4d1e-822f-d9c33bd9283d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bfd6785-aa68-41f3-860f-8add994c038b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:18 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Volume 0cb28581-edfb-4ac7-850d-2d2d937eaa91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cb28581-edfb-4ac7-850d-2d2d937eaa91', 'volume_size': 1} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-115478398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb28581-edfb-4ac7-850d-2d2d937eaa91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7752e6aa52545c7bc894514fbea66b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:19Z,use_quota=True,user_id='cf021302156d45c0a5d572495bc055ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Creating volume 0cb28581-edfb-4ac7-850d-2d2d937eaa91 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:40:18 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0cb28581-edfb-4ac7-850d-2d2d937eaa91 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:18 devstack sudo[94526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0cb28581-edfb-4ac7-850d-2d2d937eaa91 1073741824 Jul 10 04:40:18 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c698e77c-d4ed-45bf-8094-6a9ae8640d42 tempest-AttachVolumeNegativeTest-351970016 None] Acquiring lock "cinder-quobyte-f3a3e202-0fc6-44b1-a86f-61dcac851e8b" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c698e77c-d4ed-45bf-8094-6a9ae8640d42 tempest-AttachVolumeNegativeTest-351970016 None] Lock "cinder-quobyte-f3a3e202-0fc6-44b1-a86f-61dcac851e8b" acquired by "delete_volume" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2965feb-42b0-400c-b2fc-acfe6241e254]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c698e77c-d4ed-45bf-8094-6a9ae8640d42 tempest-AttachVolumeNegativeTest-351970016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f3a3e202-0fc6-44b1-a86f-61dcac851e8b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:19 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f3a3e202-0fc6-44b1-a86f-61dcac851e8b Jul 10 04:40:19 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:19 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3ff1a2dc-2d3a-4015-a002-72a224e6c332 tempest-AttachVolumeNegativeTest-351970016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.780s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:19 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-3ff1a2dc-2d3a-4015-a002-72a224e6c332 tempest-AttachVolumeNegativeTest-351970016 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:40:19 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-3ff1a2dc-2d3a-4015-a002-72a224e6c332 tempest-AttachVolumeNegativeTest-351970016 None] Deleted volume successfully. Jul 10 04:40:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3ff1a2dc-2d3a-4015-a002-72a224e6c332 tempest-AttachVolumeNegativeTest-351970016 None] Lock "cinder-392efb54-a921-4a6c-a638-0dc96a80c0b2-delete_volume" released by "delete_volume" :: held 3.073s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:19 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c698e77c-d4ed-45bf-8094-6a9ae8640d42 tempest-AttachVolumeNegativeTest-351970016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f3a3e202-0fc6-44b1-a86f-61dcac851e8b" returned: 0 in 0.995s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c698e77c-d4ed-45bf-8094-6a9ae8640d42 tempest-AttachVolumeNegativeTest-351970016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f3a3e202-0fc6-44b1-a86f-61dcac851e8b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:20 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:20 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f3a3e202-0fc6-44b1-a86f-61dcac851e8b Jul 10 04:40:20 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0cb28581-edfb-4ac7-850d-2d2d937eaa91 1073741824" returned: 0 in 1.119s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0cb28581-edfb-4ac7-850d-2d2d937eaa91 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:20 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0cb28581-edfb-4ac7-850d-2d2d937eaa91 Jul 10 04:40:20 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:20 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0cb28581-edfb-4ac7-850d-2d2d937eaa91" returned: 0 in 0.793s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:40:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:20 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c698e77c-d4ed-45bf-8094-6a9ae8640d42 tempest-AttachVolumeNegativeTest-351970016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f3a3e202-0fc6-44b1-a86f-61dcac851e8b" returned: 0 in 0.898s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:20 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c698e77c-d4ed-45bf-8094-6a9ae8640d42 tempest-AttachVolumeNegativeTest-351970016 None] Lock "cinder-quobyte-f3a3e202-0fc6-44b1-a86f-61dcac851e8b" released by "delete_volume" :: held 1.946s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bfd6785-aa68-41f3-860f-8add994c038b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cb28581-edfb-4ac7-850d-2d2d937eaa91', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3402bab3-a257-44a9-8148-4e616ccaee91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:20 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Volume volume-0cb28581-edfb-4ac7-850d-2d2d937eaa91 (0cb28581-edfb-4ac7-850d-2d2d937eaa91): created successfully Jul 10 04:40:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3402bab3-a257-44a9-8148-4e616ccaee91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Flow 'volume_create_manager' (1d1ba4ff-9ec8-4dff-95f6-eaaa4df16b37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:20 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-7b8a69f6-1298-45f4-8de5-c137ce8d2093 tempest-VolumesActionsTest-1152699420 None] Created volume successfully. Jul 10 04:40:21 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-c698e77c-d4ed-45bf-8094-6a9ae8640d42 tempest-AttachVolumeNegativeTest-351970016 None] Created reservations ['531ca9e7-e24c-4bac-b0fc-fc1ca84aa4af', '02209a48-df2c-49d2-80d6-27089eb089ae', '1f1ee8e4-38d1-4c3c-8ee1-6663e5c757a7', '0227c2fe-273e-4af3-a5ae-6695d2a4c59b'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c698e77c-d4ed-45bf-8094-6a9ae8640d42 tempest-AttachVolumeNegativeTest-351970016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c698e77c-d4ed-45bf-8094-6a9ae8640d42 tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c698e77c-d4ed-45bf-8094-6a9ae8640d42 tempest-AttachVolumeNegativeTest-351970016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c698e77c-d4ed-45bf-8094-6a9ae8640d42 tempest-AttachVolumeNegativeTest-351970016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c698e77c-d4ed-45bf-8094-6a9ae8640d42 tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c698e77c-d4ed-45bf-8094-6a9ae8640d42 tempest-AttachVolumeNegativeTest-351970016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:21 devstack sudo[94546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:40:21 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:21 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c698e77c-d4ed-45bf-8094-6a9ae8640d42 tempest-AttachVolumeNegativeTest-351970016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.804s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:21 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-c698e77c-d4ed-45bf-8094-6a9ae8640d42 tempest-AttachVolumeNegativeTest-351970016 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:40:21 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c698e77c-d4ed-45bf-8094-6a9ae8640d42 tempest-AttachVolumeNegativeTest-351970016 None] Deleted volume successfully. Jul 10 04:40:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c698e77c-d4ed-45bf-8094-6a9ae8640d42 tempest-AttachVolumeNegativeTest-351970016 None] Lock "cinder-f3a3e202-0fc6-44b1-a86f-61dcac851e8b-delete_volume" released by "delete_volume" :: held 3.281s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-23b7a0bc-e571-46d9-bd8f-59be07b1116a tempest-VolumesActionsTest-1968637615 None] Acquiring lock "cinder-0cb28581-edfb-4ac7-850d-2d2d937eaa91-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-23b7a0bc-e571-46d9-bd8f-59be07b1116a tempest-VolumesActionsTest-1968637615 None] Lock "cinder-0cb28581-edfb-4ac7-850d-2d2d937eaa91-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-23b7a0bc-e571-46d9-bd8f-59be07b1116a tempest-VolumesActionsTest-1968637615 None] Acquiring lock "cinder-quobyte-0cb28581-edfb-4ac7-850d-2d2d937eaa91" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-23b7a0bc-e571-46d9-bd8f-59be07b1116a tempest-VolumesActionsTest-1968637615 None] Lock "cinder-quobyte-0cb28581-edfb-4ac7-850d-2d2d937eaa91" acquired by "delete_volume" :: waited 0.022s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:22 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb197a5e-39e1-4604-b89f-70ff868d0848]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-23b7a0bc-e571-46d9-bd8f-59be07b1116a tempest-VolumesActionsTest-1968637615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0cb28581-edfb-4ac7-850d-2d2d937eaa91 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-53133f61-e1be-4570-ad1b-6ba3475d2e4f tempest-AttachVolumeNegativeTest-351970016 None] Acquiring lock "cinder-b3a20a9f-8547-47da-8937-6da875dffa3d-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:22 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0cb28581-edfb-4ac7-850d-2d2d937eaa91 Jul 10 04:40:22 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-53133f61-e1be-4570-ad1b-6ba3475d2e4f tempest-AttachVolumeNegativeTest-351970016 None] Lock "cinder-b3a20a9f-8547-47da-8937-6da875dffa3d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-53133f61-e1be-4570-ad1b-6ba3475d2e4f tempest-AttachVolumeNegativeTest-351970016 None] Acquiring lock "cinder-quobyte-b3a20a9f-8547-47da-8937-6da875dffa3d" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-53133f61-e1be-4570-ad1b-6ba3475d2e4f tempest-AttachVolumeNegativeTest-351970016 None] Lock "cinder-quobyte-b3a20a9f-8547-47da-8937-6da875dffa3d" acquired by "delete_volume" :: waited 0.038s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:22 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97c14ef-bdb1-42d4-8194-259cd637af0d]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-53133f61-e1be-4570-ad1b-6ba3475d2e4f tempest-AttachVolumeNegativeTest-351970016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b3a20a9f-8547-47da-8937-6da875dffa3d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:22 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b3a20a9f-8547-47da-8937-6da875dffa3d Jul 10 04:40:22 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:23 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-23b7a0bc-e571-46d9-bd8f-59be07b1116a tempest-VolumesActionsTest-1968637615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0cb28581-edfb-4ac7-850d-2d2d937eaa91" returned: 0 in 0.964s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-23b7a0bc-e571-46d9-bd8f-59be07b1116a tempest-VolumesActionsTest-1968637615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0cb28581-edfb-4ac7-850d-2d2d937eaa91 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:23 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0cb28581-edfb-4ac7-850d-2d2d937eaa91 Jul 10 04:40:23 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:23 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-53133f61-e1be-4570-ad1b-6ba3475d2e4f tempest-AttachVolumeNegativeTest-351970016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b3a20a9f-8547-47da-8937-6da875dffa3d" returned: 0 in 0.894s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-53133f61-e1be-4570-ad1b-6ba3475d2e4f tempest-AttachVolumeNegativeTest-351970016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b3a20a9f-8547-47da-8937-6da875dffa3d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:23 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b3a20a9f-8547-47da-8937-6da875dffa3d Jul 10 04:40:23 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:24 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-23b7a0bc-e571-46d9-bd8f-59be07b1116a tempest-VolumesActionsTest-1968637615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0cb28581-edfb-4ac7-850d-2d2d937eaa91" returned: 0 in 0.949s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-23b7a0bc-e571-46d9-bd8f-59be07b1116a tempest-VolumesActionsTest-1968637615 None] Lock "cinder-quobyte-0cb28581-edfb-4ac7-850d-2d2d937eaa91" released by "delete_volume" :: held 2.000s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:24 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-23b7a0bc-e571-46d9-bd8f-59be07b1116a tempest-VolumesActionsTest-1968637615 None] Created reservations ['75db86d9-2ae3-482b-93e8-c3f4c56cde4f', 'd5ef70d3-7296-48e8-a37b-932754b08ae3', '186a0fd8-f016-4e71-8bc2-3d14f91967d3', 'e8ac3988-18aa-4d42-b9da-2d28cba4f952'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-23b7a0bc-e571-46d9-bd8f-59be07b1116a tempest-VolumesActionsTest-1968637615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-23b7a0bc-e571-46d9-bd8f-59be07b1116a tempest-VolumesActionsTest-1968637615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-23b7a0bc-e571-46d9-bd8f-59be07b1116a tempest-VolumesActionsTest-1968637615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-23b7a0bc-e571-46d9-bd8f-59be07b1116a tempest-VolumesActionsTest-1968637615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-23b7a0bc-e571-46d9-bd8f-59be07b1116a tempest-VolumesActionsTest-1968637615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-23b7a0bc-e571-46d9-bd8f-59be07b1116a tempest-VolumesActionsTest-1968637615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:24 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-53133f61-e1be-4570-ad1b-6ba3475d2e4f tempest-AttachVolumeNegativeTest-351970016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b3a20a9f-8547-47da-8937-6da875dffa3d" returned: 0 in 1.062s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:24 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:40:24 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-53133f61-e1be-4570-ad1b-6ba3475d2e4f tempest-AttachVolumeNegativeTest-351970016 None] Lock "cinder-quobyte-b3a20a9f-8547-47da-8937-6da875dffa3d" released by "delete_volume" :: held 2.022s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:24 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-53133f61-e1be-4570-ad1b-6ba3475d2e4f tempest-AttachVolumeNegativeTest-351970016 None] Created reservations ['9af12b21-a519-41d1-89cf-ac404fe2182f', '7c964ed0-3531-4eee-a4b8-f4446e6c7842', 'cc476c54-695f-4da0-9504-f7e430807a15', '06b1d965-930d-4a86-aed0-8630cf5249c5'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-53133f61-e1be-4570-ad1b-6ba3475d2e4f tempest-AttachVolumeNegativeTest-351970016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-53133f61-e1be-4570-ad1b-6ba3475d2e4f tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-53133f61-e1be-4570-ad1b-6ba3475d2e4f tempest-AttachVolumeNegativeTest-351970016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-53133f61-e1be-4570-ad1b-6ba3475d2e4f tempest-AttachVolumeNegativeTest-351970016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-53133f61-e1be-4570-ad1b-6ba3475d2e4f tempest-AttachVolumeNegativeTest-351970016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-53133f61-e1be-4570-ad1b-6ba3475d2e4f tempest-AttachVolumeNegativeTest-351970016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:24 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:40:24 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:25 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-23b7a0bc-e571-46d9-bd8f-59be07b1116a tempest-VolumesActionsTest-1968637615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.754s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:25 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-23b7a0bc-e571-46d9-bd8f-59be07b1116a tempest-VolumesActionsTest-1968637615 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:40:25 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-23b7a0bc-e571-46d9-bd8f-59be07b1116a tempest-VolumesActionsTest-1968637615 None] Deleted volume successfully. Jul 10 04:40:25 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-23b7a0bc-e571-46d9-bd8f-59be07b1116a tempest-VolumesActionsTest-1968637615 None] Lock "cinder-0cb28581-edfb-4ac7-850d-2d2d937eaa91-delete_volume" released by "delete_volume" :: held 3.175s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:25 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-53133f61-e1be-4570-ad1b-6ba3475d2e4f tempest-AttachVolumeNegativeTest-351970016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.053s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:25 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-53133f61-e1be-4570-ad1b-6ba3475d2e4f tempest-AttachVolumeNegativeTest-351970016 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:40:25 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-53133f61-e1be-4570-ad1b-6ba3475d2e4f tempest-AttachVolumeNegativeTest-351970016 None] Deleted volume successfully. Jul 10 04:40:25 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-53133f61-e1be-4570-ad1b-6ba3475d2e4f tempest-AttachVolumeNegativeTest-351970016 None] Lock "cinder-b3a20a9f-8547-47da-8937-6da875dffa3d-delete_volume" released by "delete_volume" :: held 3.469s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:26 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:40:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Flow 'volume_create_manager' (3e590c24-26a3-4a63-8f12-c7804394baed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce82390-cb00-4182-a31e-0f348839687d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce82390-cb00-4182-a31e-0f348839687d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-694982643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4809695-b74a-41b2-9375-f03565ccb6cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7752e6aa52545c7bc894514fbea66b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:26Z,use_quota=True,user_id='cf021302156d45c0a5d572495bc055ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc1c3cf-8b13-4eb7-b070-dbe0e43c5447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc1c3cf-8b13-4eb7-b070-dbe0e43c5447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9e692b-a39e-4360-a827-84b722d0603d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9e692b-a39e-4360-a827-84b722d0603d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4809695-b74a-41b2-9375-f03565ccb6cf', 'volume_name': 'volume-e4809695-b74a-41b2-9375-f03565ccb6cf', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7357fc8-ab50-4532-ae00-a6d6a90d398b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7357fc8-ab50-4532-ae00-a6d6a90d398b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf36082b-e75e-4f87-9b3c-22a2d34bd348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:26 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Volume e4809695-b74a-41b2-9375-f03565ccb6cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4809695-b74a-41b2-9375-f03565ccb6cf', 'volume_size': 1} Jul 10 04:40:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-694982643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4809695-b74a-41b2-9375-f03565ccb6cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7752e6aa52545c7bc894514fbea66b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:26Z,use_quota=True,user_id='cf021302156d45c0a5d572495bc055ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:40:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Creating volume e4809695-b74a-41b2-9375-f03565ccb6cf {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:40:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:40:26 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:40:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4809695-b74a-41b2-9375-f03565ccb6cf 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:26 devstack sudo[94589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4809695-b74a-41b2-9375-f03565ccb6cf 1073741824 Jul 10 04:40:26 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:27 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4809695-b74a-41b2-9375-f03565ccb6cf 1073741824" returned: 0 in 1.240s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4809695-b74a-41b2-9375-f03565ccb6cf {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:27 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4809695-b74a-41b2-9375-f03565ccb6cf Jul 10 04:40:27 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:28 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4809695-b74a-41b2-9375-f03565ccb6cf" returned: 0 in 1.032s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] <== create_volume: return (2349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:40:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.353s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf36082b-e75e-4f87-9b3c-22a2d34bd348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4809695-b74a-41b2-9375-f03565ccb6cf', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da135c0-1d61-45f7-b496-d104dd910a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:28 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Volume volume-e4809695-b74a-41b2-9375-f03565ccb6cf (e4809695-b74a-41b2-9375-f03565ccb6cf): created successfully Jul 10 04:40:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da135c0-1d61-45f7-b496-d104dd910a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Flow 'volume_create_manager' (3e590c24-26a3-4a63-8f12-c7804394baed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:29 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-24ff821f-26aa-4f82-aaca-33d6a26876ec tempest-VolumesActionsTest-1152699420 None] Created volume successfully. Jul 10 04:40:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-015aa73f-ddfc-47c3-8899-e33d420543dc tempest-VolumesActionsTest-1968637615 None] Acquiring lock "cinder-e4809695-b74a-41b2-9375-f03565ccb6cf-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-015aa73f-ddfc-47c3-8899-e33d420543dc tempest-VolumesActionsTest-1968637615 None] Lock "cinder-e4809695-b74a-41b2-9375-f03565ccb6cf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-015aa73f-ddfc-47c3-8899-e33d420543dc tempest-VolumesActionsTest-1968637615 None] Acquiring lock "cinder-quobyte-e4809695-b74a-41b2-9375-f03565ccb6cf" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-015aa73f-ddfc-47c3-8899-e33d420543dc tempest-VolumesActionsTest-1968637615 None] Lock "cinder-quobyte-e4809695-b74a-41b2-9375-f03565ccb6cf" acquired by "delete_volume" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:30 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd732b8-9e9e-4317-911b-7fa5eca55f92]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-015aa73f-ddfc-47c3-8899-e33d420543dc tempest-VolumesActionsTest-1968637615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4809695-b74a-41b2-9375-f03565ccb6cf {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:30 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4809695-b74a-41b2-9375-f03565ccb6cf Jul 10 04:40:30 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:30 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-015aa73f-ddfc-47c3-8899-e33d420543dc tempest-VolumesActionsTest-1968637615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4809695-b74a-41b2-9375-f03565ccb6cf" returned: 0 in 0.971s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-015aa73f-ddfc-47c3-8899-e33d420543dc tempest-VolumesActionsTest-1968637615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4809695-b74a-41b2-9375-f03565ccb6cf {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:31 devstack sudo[94610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4809695-b74a-41b2-9375-f03565ccb6cf Jul 10 04:40:31 devstack sudo[94610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:31 devstack sudo[94610]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-015aa73f-ddfc-47c3-8899-e33d420543dc tempest-VolumesActionsTest-1968637615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e4809695-b74a-41b2-9375-f03565ccb6cf" returned: 0 in 0.852s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:31 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-015aa73f-ddfc-47c3-8899-e33d420543dc tempest-VolumesActionsTest-1968637615 None] Lock "cinder-quobyte-e4809695-b74a-41b2-9375-f03565ccb6cf" released by "delete_volume" :: held 1.881s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:31 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-015aa73f-ddfc-47c3-8899-e33d420543dc tempest-VolumesActionsTest-1968637615 None] Created reservations ['27046989-aac0-4f77-b49c-dd8b9640be59', '41cb05de-cec7-49a1-9981-ec4f84de819e', '2be70c64-b9db-41e7-9c7e-6bbc64270d6e', 'b0102705-75a5-40ed-a621-a3a5551fcb06'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-015aa73f-ddfc-47c3-8899-e33d420543dc tempest-VolumesActionsTest-1968637615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-015aa73f-ddfc-47c3-8899-e33d420543dc tempest-VolumesActionsTest-1968637615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-015aa73f-ddfc-47c3-8899-e33d420543dc tempest-VolumesActionsTest-1968637615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-015aa73f-ddfc-47c3-8899-e33d420543dc tempest-VolumesActionsTest-1968637615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-015aa73f-ddfc-47c3-8899-e33d420543dc tempest-VolumesActionsTest-1968637615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-015aa73f-ddfc-47c3-8899-e33d420543dc tempest-VolumesActionsTest-1968637615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:32 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:40:32 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Flow 'volume_create_manager' (6a63338d-a00b-41d0-a1a8-9319a00d02b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa5077e-0233-4925-b974-6cc1f7768339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa5077e-0233-4925-b974-6cc1f7768339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2035042523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5657d39-5289-425f-a933-ed23cb7d635e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7752e6aa52545c7bc894514fbea66b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:33Z,use_quota=True,user_id='cf021302156d45c0a5d572495bc055ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5572c2-7946-4721-9ff2-5abe1bca74ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5572c2-7946-4721-9ff2-5abe1bca74ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bbfddc-340d-4e4b-8598-c1c2052ca188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bbfddc-340d-4e4b-8598-c1c2052ca188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5657d39-5289-425f-a933-ed23cb7d635e', 'volume_name': 'volume-c5657d39-5289-425f-a933-ed23cb7d635e', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee5f02c-a174-41cf-8735-6a31bf531c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee5f02c-a174-41cf-8735-6a31bf531c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd4feb6-a523-46a1-84d5-3e7b056e13a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:33 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Volume c5657d39-5289-425f-a933-ed23cb7d635e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5657d39-5289-425f-a933-ed23cb7d635e', 'volume_size': 1} Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2035042523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5657d39-5289-425f-a933-ed23cb7d635e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7752e6aa52545c7bc894514fbea66b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:33Z,use_quota=True,user_id='cf021302156d45c0a5d572495bc055ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Creating volume c5657d39-5289-425f-a933-ed23cb7d635e {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:40:33 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5657d39-5289-425f-a933-ed23cb7d635e 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:33 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5657d39-5289-425f-a933-ed23cb7d635e 1073741824 Jul 10 04:40:33 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:33 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-015aa73f-ddfc-47c3-8899-e33d420543dc tempest-VolumesActionsTest-1968637615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.303s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-015aa73f-ddfc-47c3-8899-e33d420543dc tempest-VolumesActionsTest-1968637615 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:40:33 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-015aa73f-ddfc-47c3-8899-e33d420543dc tempest-VolumesActionsTest-1968637615 None] Deleted volume successfully. Jul 10 04:40:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-015aa73f-ddfc-47c3-8899-e33d420543dc tempest-VolumesActionsTest-1968637615 None] Lock "cinder-e4809695-b74a-41b2-9375-f03565ccb6cf-delete_volume" released by "delete_volume" :: held 3.553s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:34 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5657d39-5289-425f-a933-ed23cb7d635e 1073741824" returned: 0 in 1.039s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5657d39-5289-425f-a933-ed23cb7d635e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:34 devstack sudo[94674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5657d39-5289-425f-a933-ed23cb7d635e Jul 10 04:40:34 devstack sudo[94674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:35 devstack sudo[94674]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5657d39-5289-425f-a933-ed23cb7d635e" returned: 0 in 0.786s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd4feb6-a523-46a1-84d5-3e7b056e13a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5657d39-5289-425f-a933-ed23cb7d635e', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54883c3-52d6-4ddc-9ce9-44cdb8505223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:35 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Volume volume-c5657d39-5289-425f-a933-ed23cb7d635e (c5657d39-5289-425f-a933-ed23cb7d635e): created successfully Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54883c3-52d6-4ddc-9ce9-44cdb8505223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Flow 'volume_create_manager' (6a63338d-a00b-41d0-a1a8-9319a00d02b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:35 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-696ef579-e72c-4653-8f65-35d897bd385b tempest-VolumesActionsTest-1152699420 None] Created volume successfully. Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Flow 'volume_create_manager' (5097df8f-6ffd-4934-b148-13bb8043f8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcdfbd35-5475-4bd0-9d95-b361584d4dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcdfbd35-5475-4bd0-9d95-b361584d4dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1046062031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40026ae0-02da-408a-8edc-3be10382ef38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba783514003f4ef293245e2a8f979a5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:36Z,use_quota=True,user_id='b5ed9f36221e4c4a9a1f52afca0dc3eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98c1cfa-1377-45f8-8142-4cedd3c7b1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98c1cfa-1377-45f8-8142-4cedd3c7b1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (278e03d4-ef4b-4693-8c18-5b9b8237b965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (278e03d4-ef4b-4693-8c18-5b9b8237b965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40026ae0-02da-408a-8edc-3be10382ef38', 'volume_name': 'volume-40026ae0-02da-408a-8edc-3be10382ef38', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2e557f-147d-4582-bc52-b2e1bee56b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2e557f-147d-4582-bc52-b2e1bee56b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c861596-749b-4735-a76f-0da5b48efb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:35 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Volume 40026ae0-02da-408a-8edc-3be10382ef38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40026ae0-02da-408a-8edc-3be10382ef38', 'volume_size': 1} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1046062031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40026ae0-02da-408a-8edc-3be10382ef38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba783514003f4ef293245e2a8f979a5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:36Z,use_quota=True,user_id='b5ed9f36221e4c4a9a1f52afca0dc3eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Creating volume 40026ae0-02da-408a-8edc-3be10382ef38 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:40:35 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:40:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:35 devstack sudo[94698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38 1073741824 Jul 10 04:40:35 devstack sudo[94698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-81bb01a7-4107-4ebb-8873-0e4ab0181b44 tempest-VolumesActionsTest-1968637615 None] Acquiring lock "cinder-c5657d39-5289-425f-a933-ed23cb7d635e-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-81bb01a7-4107-4ebb-8873-0e4ab0181b44 tempest-VolumesActionsTest-1968637615 None] Lock "cinder-c5657d39-5289-425f-a933-ed23cb7d635e-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-81bb01a7-4107-4ebb-8873-0e4ab0181b44 tempest-VolumesActionsTest-1968637615 None] Acquiring lock "cinder-quobyte-c5657d39-5289-425f-a933-ed23cb7d635e" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-81bb01a7-4107-4ebb-8873-0e4ab0181b44 tempest-VolumesActionsTest-1968637615 None] Lock "cinder-quobyte-c5657d39-5289-425f-a933-ed23cb7d635e" acquired by "delete_volume" :: waited 0.062s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:37 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bbc6db-6d9f-4614-8800-029240034249]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-81bb01a7-4107-4ebb-8873-0e4ab0181b44 tempest-VolumesActionsTest-1968637615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5657d39-5289-425f-a933-ed23cb7d635e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:37 devstack sudo[94701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5657d39-5289-425f-a933-ed23cb7d635e Jul 10 04:40:37 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:38 devstack sudo[94698]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38 1073741824" returned: 0 in 2.218s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:38 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38 Jul 10 04:40:38 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:38 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-81bb01a7-4107-4ebb-8873-0e4ab0181b44 tempest-VolumesActionsTest-1968637615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5657d39-5289-425f-a933-ed23cb7d635e" returned: 0 in 1.614s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-81bb01a7-4107-4ebb-8873-0e4ab0181b44 tempest-VolumesActionsTest-1968637615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5657d39-5289-425f-a933-ed23cb7d635e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:38 devstack sudo[94713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5657d39-5289-425f-a933-ed23cb7d635e Jul 10 04:40:38 devstack sudo[94713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:39 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38" returned: 0 in 1.132s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] <== create_volume: return (3439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:40:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.443s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c861596-749b-4735-a76f-0da5b48efb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40026ae0-02da-408a-8edc-3be10382ef38', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31de3fb4-197c-46de-944b-c1c18de1fdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:39 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Volume volume-40026ae0-02da-408a-8edc-3be10382ef38 (40026ae0-02da-408a-8edc-3be10382ef38): created successfully Jul 10 04:40:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31de3fb4-197c-46de-944b-c1c18de1fdec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Flow 'volume_create_manager' (5097df8f-6ffd-4934-b148-13bb8043f8d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:39 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-209605e5-1837-4c1f-9fcd-4ceaca6747c8 req-330e7bcd-60c5-4b60-b437-6ad4de7b3761 tempest-VolumesSnapshotsTestJSON-666190068 None] Created volume successfully. Jul 10 04:40:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-2e10ded2-f868-493f-9cc7-16f39f4fc701 req-b6e50f12-6df9-4d1e-b716-aa9fe7225fdf tempest-VolumesSnapshotsTestJSON-666190068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-2e10ded2-f868-493f-9cc7-16f39f4fc701 req-b6e50f12-6df9-4d1e-b716-aa9fe7225fdf tempest-VolumesSnapshotsTestJSON-666190068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [req-2e10ded2-f868-493f-9cc7-16f39f4fc701 req-b6e50f12-6df9-4d1e-b716-aa9fe7225fdf tempest-VolumesSnapshotsTestJSON-666190068 None] Creating offline snapshot e8b8e821-5f63-430d-830b-205a0b885115 of volume 40026ae0-02da-408a-8edc-3be10382ef38 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:40:40 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6f6a65-e0e7-4374-960b-6d0ba3e5badb]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-2e10ded2-f868-493f-9cc7-16f39f4fc701 req-b6e50f12-6df9-4d1e-b716-aa9fe7225fdf tempest-VolumesSnapshotsTestJSON-666190068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:40 devstack sudo[94713]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-81bb01a7-4107-4ebb-8873-0e4ab0181b44 tempest-VolumesActionsTest-1968637615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5657d39-5289-425f-a933-ed23cb7d635e" returned: 0 in 1.638s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:40 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-81bb01a7-4107-4ebb-8873-0e4ab0181b44 tempest-VolumesActionsTest-1968637615 None] Lock "cinder-quobyte-c5657d39-5289-425f-a933-ed23cb7d635e" released by "delete_volume" :: held 3.372s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:40 devstack sudo[94739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38 Jul 10 04:40:40 devstack sudo[94739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:40 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-81bb01a7-4107-4ebb-8873-0e4ab0181b44 tempest-VolumesActionsTest-1968637615 None] Created reservations ['a7d4d038-7c06-41bb-805e-b6486547c4c2', '42720113-b768-483e-aa99-719828f8be9d', '0e9c951b-f8fb-4a8f-b6f6-c93077b3a610', 'aecc8ef8-cd66-468e-8b97-ce27de8c50d0'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-81bb01a7-4107-4ebb-8873-0e4ab0181b44 tempest-VolumesActionsTest-1968637615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-81bb01a7-4107-4ebb-8873-0e4ab0181b44 tempest-VolumesActionsTest-1968637615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-81bb01a7-4107-4ebb-8873-0e4ab0181b44 tempest-VolumesActionsTest-1968637615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-81bb01a7-4107-4ebb-8873-0e4ab0181b44 tempest-VolumesActionsTest-1968637615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-81bb01a7-4107-4ebb-8873-0e4ab0181b44 tempest-VolumesActionsTest-1968637615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-81bb01a7-4107-4ebb-8873-0e4ab0181b44 tempest-VolumesActionsTest-1968637615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:40 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:40:40 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:41 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-81bb01a7-4107-4ebb-8873-0e4ab0181b44 tempest-VolumesActionsTest-1968637615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.981s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:41 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-81bb01a7-4107-4ebb-8873-0e4ab0181b44 tempest-VolumesActionsTest-1968637615 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:40:41 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-81bb01a7-4107-4ebb-8873-0e4ab0181b44 tempest-VolumesActionsTest-1968637615 None] Deleted volume successfully. Jul 10 04:40:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-81bb01a7-4107-4ebb-8873-0e4ab0181b44 tempest-VolumesActionsTest-1968637615 None] Lock "cinder-c5657d39-5289-425f-a933-ed23cb7d635e-delete_volume" released by "delete_volume" :: held 4.957s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:41 devstack sudo[94739]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-2e10ded2-f868-493f-9cc7-16f39f4fc701 req-b6e50f12-6df9-4d1e-b716-aa9fe7225fdf tempest-VolumesSnapshotsTestJSON-666190068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38" returned: 0 in 1.507s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-2e10ded2-f868-493f-9cc7-16f39f4fc701 req-b6e50f12-6df9-4d1e-b716-aa9fe7225fdf tempest-VolumesSnapshotsTestJSON-666190068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.e8b8e821-5f63-430d-830b-205a0b885115 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:41 devstack sudo[94761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.e8b8e821-5f63-430d-830b-205a0b885115 1G Jul 10 04:40:41 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:42 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:40:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Flow 'volume_create_manager' (1b3ecf96-1b5d-481e-afa7-77268c1eed41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf53402-c389-43d8-80a8-6d781678021c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf53402-c389-43d8-80a8-6d781678021c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-883402010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=120b6584-3427-4992-b370-49831edbe85c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7752e6aa52545c7bc894514fbea66b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:42Z,use_quota=True,user_id='cf021302156d45c0a5d572495bc055ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (045b1a96-71c2-461b-8ecc-fb38f1b36d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (045b1a96-71c2-461b-8ecc-fb38f1b36d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6c9f03-5622-46b9-8634-298300a50dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6c9f03-5622-46b9-8634-298300a50dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '120b6584-3427-4992-b370-49831edbe85c', 'volume_name': 'volume-120b6584-3427-4992-b370-49831edbe85c', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b749e7-93e2-4942-a840-62162062eddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b749e7-93e2-4942-a840-62162062eddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9008f677-c7e4-4bba-af79-9403d72de551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:42 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Volume 120b6584-3427-4992-b370-49831edbe85c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-120b6584-3427-4992-b370-49831edbe85c', 'volume_size': 1} Jul 10 04:40:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:42 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-2e10ded2-f868-493f-9cc7-16f39f4fc701 req-b6e50f12-6df9-4d1e-b716-aa9fe7225fdf tempest-VolumesSnapshotsTestJSON-666190068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.e8b8e821-5f63-430d-830b-205a0b885115 1G" returned: 0 in 1.211s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-2e10ded2-f868-493f-9cc7-16f39f4fc701 req-b6e50f12-6df9-4d1e-b716-aa9fe7225fdf tempest-VolumesSnapshotsTestJSON-666190068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40026ae0-02da-408a-8edc-3be10382ef38 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.e8b8e821-5f63-430d-830b-205a0b885115 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:43 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40026ae0-02da-408a-8edc-3be10382ef38 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.e8b8e821-5f63-430d-830b-205a0b885115 Jul 10 04:40:43 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:43 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-2e10ded2-f868-493f-9cc7-16f39f4fc701 req-b6e50f12-6df9-4d1e-b716-aa9fe7225fdf tempest-VolumesSnapshotsTestJSON-666190068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40026ae0-02da-408a-8edc-3be10382ef38 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.e8b8e821-5f63-430d-830b-205a0b885115" returned: 0 in 0.996s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:43 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [req-2e10ded2-f868-493f-9cc7-16f39f4fc701 req-b6e50f12-6df9-4d1e-b716-aa9fe7225fdf tempest-VolumesSnapshotsTestJSON-666190068 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.e8b8e821-5f63-430d-830b-205a0b885115 is being set with open permissions: ugo+rw Jul 10 04:40:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-2e10ded2-f868-493f-9cc7-16f39f4fc701 req-b6e50f12-6df9-4d1e-b716-aa9fe7225fdf tempest-VolumesSnapshotsTestJSON-666190068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.e8b8e821-5f63-430d-830b-205a0b885115 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:44 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.e8b8e821-5f63-430d-830b-205a0b885115 Jul 10 04:40:44 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:44 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-2e10ded2-f868-493f-9cc7-16f39f4fc701 req-b6e50f12-6df9-4d1e-b716-aa9fe7225fdf tempest-VolumesSnapshotsTestJSON-666190068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.e8b8e821-5f63-430d-830b-205a0b885115" returned: 0 in 0.867s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-2e10ded2-f868-493f-9cc7-16f39f4fc701 req-b6e50f12-6df9-4d1e-b716-aa9fe7225fdf tempest-VolumesSnapshotsTestJSON-666190068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:44 devstack sudo[94823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.info Jul 10 04:40:44 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:45 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-2e10ded2-f868-493f-9cc7-16f39f4fc701 req-b6e50f12-6df9-4d1e-b716-aa9fe7225fdf tempest-VolumesSnapshotsTestJSON-666190068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.info" returned: 0 in 0.752s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:45 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [req-2e10ded2-f868-493f-9cc7-16f39f4fc701 req-b6e50f12-6df9-4d1e-b716-aa9fe7225fdf tempest-VolumesSnapshotsTestJSON-666190068 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.info is being set with open permissions: ugo+rw Jul 10 04:40:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-2e10ded2-f868-493f-9cc7-16f39f4fc701 req-b6e50f12-6df9-4d1e-b716-aa9fe7225fdf tempest-VolumesSnapshotsTestJSON-666190068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:45 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.info Jul 10 04:40:45 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:46 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-2e10ded2-f868-493f-9cc7-16f39f4fc701 req-b6e50f12-6df9-4d1e-b716-aa9fe7225fdf tempest-VolumesSnapshotsTestJSON-666190068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.info" returned: 0 in 0.827s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-2e10ded2-f868-493f-9cc7-16f39f4fc701 req-b6e50f12-6df9-4d1e-b716-aa9fe7225fdf tempest-VolumesSnapshotsTestJSON-666190068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.373s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.121s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-883402010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=120b6584-3427-4992-b370-49831edbe85c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7752e6aa52545c7bc894514fbea66b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:42Z,use_quota=True,user_id='cf021302156d45c0a5d572495bc055ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:40:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Creating volume 120b6584-3427-4992-b370-49831edbe85c {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:40:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:40:46 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:40:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-120b6584-3427-4992-b370-49831edbe85c 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:46 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-120b6584-3427-4992-b370-49831edbe85c 1073741824 Jul 10 04:40:46 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:46 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-2e10ded2-f868-493f-9cc7-16f39f4fc701 req-b6e50f12-6df9-4d1e-b716-aa9fe7225fdf tempest-VolumesSnapshotsTestJSON-666190068 None] Create snapshot completed successfully Jul 10 04:40:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-7ce1fe64-3d41-40ba-a121-5629a2a8d8cf req-43f90455-6860-4ea1-8cea-3001c06feada tempest-VolumesSnapshotsTestJSON-666190068 None] Acquiring lock "cinder-e8b8e821-5f63-430d-830b-205a0b885115-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-7ce1fe64-3d41-40ba-a121-5629a2a8d8cf req-43f90455-6860-4ea1-8cea-3001c06feada tempest-VolumesSnapshotsTestJSON-666190068 None] Lock "cinder-e8b8e821-5f63-430d-830b-205a0b885115-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-7ce1fe64-3d41-40ba-a121-5629a2a8d8cf req-43f90455-6860-4ea1-8cea-3001c06feada tempest-VolumesSnapshotsTestJSON-666190068 None] Acquiring lock "cinder-quobyte-40026ae0-02da-408a-8edc-3be10382ef38" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-7ce1fe64-3d41-40ba-a121-5629a2a8d8cf req-43f90455-6860-4ea1-8cea-3001c06feada tempest-VolumesSnapshotsTestJSON-666190068 None] Lock "cinder-quobyte-40026ae0-02da-408a-8edc-3be10382ef38" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-7ce1fe64-3d41-40ba-a121-5629a2a8d8cf req-43f90455-6860-4ea1-8cea-3001c06feada tempest-VolumesSnapshotsTestJSON-666190068 None] Acquiring lock "cinder-quobyte-e8b8e821-5f63-430d-830b-205a0b885115" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-7ce1fe64-3d41-40ba-a121-5629a2a8d8cf req-43f90455-6860-4ea1-8cea-3001c06feada tempest-VolumesSnapshotsTestJSON-666190068 None] Lock "cinder-quobyte-e8b8e821-5f63-430d-830b-205a0b885115" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [req-7ce1fe64-3d41-40ba-a121-5629a2a8d8cf req-43f90455-6860-4ea1-8cea-3001c06feada tempest-VolumesSnapshotsTestJSON-666190068 None] Deleting offline snapshot e8b8e821-5f63-430d-830b-205a0b885115 of volume 40026ae0-02da-408a-8edc-3be10382ef38 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:40:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [req-7ce1fe64-3d41-40ba-a121-5629a2a8d8cf req-43f90455-6860-4ea1-8cea-3001c06feada tempest-VolumesSnapshotsTestJSON-666190068 None] snapshot_file for this snap is: volume-40026ae0-02da-408a-8edc-3be10382ef38.e8b8e821-5f63-430d-830b-205a0b885115 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:40:47 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[10010b75-1c17-4611-aa13-25c96a59a0f7]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-7ce1fe64-3d41-40ba-a121-5629a2a8d8cf req-43f90455-6860-4ea1-8cea-3001c06feada tempest-VolumesSnapshotsTestJSON-666190068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.e8b8e821-5f63-430d-830b-205a0b885115 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:47 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.e8b8e821-5f63-430d-830b-205a0b885115 Jul 10 04:40:47 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:47 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-120b6584-3427-4992-b370-49831edbe85c 1073741824" returned: 0 in 1.293s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-120b6584-3427-4992-b370-49831edbe85c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:47 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-120b6584-3427-4992-b370-49831edbe85c Jul 10 04:40:47 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:48 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-7ce1fe64-3d41-40ba-a121-5629a2a8d8cf req-43f90455-6860-4ea1-8cea-3001c06feada tempest-VolumesSnapshotsTestJSON-666190068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.e8b8e821-5f63-430d-830b-205a0b885115" returned: 0 in 1.530s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [req-7ce1fe64-3d41-40ba-a121-5629a2a8d8cf req-43f90455-6860-4ea1-8cea-3001c06feada tempest-VolumesSnapshotsTestJSON-666190068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40026ae0-02da-408a-8edc-3be10382ef38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:40:48 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[166debeb-897e-4624-8c59-6c1dbb953cb2]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-7ce1fe64-3d41-40ba-a121-5629a2a8d8cf req-43f90455-6860-4ea1-8cea-3001c06feada tempest-VolumesSnapshotsTestJSON-666190068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:49 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-120b6584-3427-4992-b370-49831edbe85c" returned: 0 in 1.158s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] <== create_volume: return (2512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:40:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.523s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9008f677-c7e4-4bba-af79-9403d72de551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-120b6584-3427-4992-b370-49831edbe85c', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8dd482a-1a78-42c3-b95f-63fb0ae70051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:49 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Volume volume-120b6584-3427-4992-b370-49831edbe85c (120b6584-3427-4992-b370-49831edbe85c): created successfully Jul 10 04:40:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8dd482a-1a78-42c3-b95f-63fb0ae70051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Flow 'volume_create_manager' (1b3ecf96-1b5d-481e-afa7-77268c1eed41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:49 devstack sudo[94884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38 Jul 10 04:40:49 devstack sudo[94884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:49 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ec3114cd-e0cb-4687-b4b6-89bfabcd2462 tempest-VolumesActionsTest-1152699420 None] Created volume successfully. Jul 10 04:40:49 devstack sudo[94884]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-7ce1fe64-3d41-40ba-a121-5629a2a8d8cf req-43f90455-6860-4ea1-8cea-3001c06feada tempest-VolumesSnapshotsTestJSON-666190068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38" returned: 0 in 0.950s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-7ce1fe64-3d41-40ba-a121-5629a2a8d8cf req-43f90455-6860-4ea1-8cea-3001c06feada tempest-VolumesSnapshotsTestJSON-666190068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.e8b8e821-5f63-430d-830b-205a0b885115 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:49 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.e8b8e821-5f63-430d-830b-205a0b885115 Jul 10 04:40:49 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Flow 'volume_create_manager' (e45b0bb8-352f-4243-a4b9-55c77517e55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6f68e0-53b3-4e13-a99a-94cd07dfd405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6f68e0-53b3-4e13-a99a-94cd07dfd405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-696006331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df8746e-e510-474f-aea9-2d020f1dd901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='328020eaaa49404da4ec15cb38e87025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:50Z,use_quota=True,user_id='66aaef1e45004a56954df7946c99d294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97002097-10a9-465a-8a3c-ca099a2e4a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97002097-10a9-465a-8a3c-ca099a2e4a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233fd336-2a8e-4d97-b50e-61c15b563474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233fd336-2a8e-4d97-b50e-61c15b563474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5df8746e-e510-474f-aea9-2d020f1dd901', 'volume_name': 'volume-5df8746e-e510-474f-aea9-2d020f1dd901', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0a75ad-9103-4ab8-9fcb-8f439d17ba33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0a75ad-9103-4ab8-9fcb-8f439d17ba33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afacf8af-ca5d-40be-8912-e60d0ac2e7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:50 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Volume 5df8746e-e510-474f-aea9-2d020f1dd901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5df8746e-e510-474f-aea9-2d020f1dd901', 'volume_size': 1} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-696006331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df8746e-e510-474f-aea9-2d020f1dd901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='328020eaaa49404da4ec15cb38e87025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:50Z,use_quota=True,user_id='66aaef1e45004a56954df7946c99d294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Creating volume 5df8746e-e510-474f-aea9-2d020f1dd901 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:40:50 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5df8746e-e510-474f-aea9-2d020f1dd901 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:50 devstack sudo[94892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5df8746e-e510-474f-aea9-2d020f1dd901 1073741824 Jul 10 04:40:50 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-676d6fb9-88be-46d3-a9ee-fe0dec7461fe tempest-VolumesActionsTest-1152699420 None] Acquiring lock "cinder-120b6584-3427-4992-b370-49831edbe85c-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-676d6fb9-88be-46d3-a9ee-fe0dec7461fe tempest-VolumesActionsTest-1152699420 None] Lock "cinder-120b6584-3427-4992-b370-49831edbe85c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-676d6fb9-88be-46d3-a9ee-fe0dec7461fe tempest-VolumesActionsTest-1152699420 None] Acquiring lock "cinder-quobyte-120b6584-3427-4992-b370-49831edbe85c" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-676d6fb9-88be-46d3-a9ee-fe0dec7461fe tempest-VolumesActionsTest-1152699420 None] Lock "cinder-quobyte-120b6584-3427-4992-b370-49831edbe85c" acquired by "delete_volume" :: waited 0.023s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[732ca167-ed08-4c18-8e97-ef206a7ccd40]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-676d6fb9-88be-46d3-a9ee-fe0dec7461fe tempest-VolumesActionsTest-1152699420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-120b6584-3427-4992-b370-49831edbe85c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:50 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-120b6584-3427-4992-b370-49831edbe85c Jul 10 04:40:50 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:50 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-7ce1fe64-3d41-40ba-a121-5629a2a8d8cf req-43f90455-6860-4ea1-8cea-3001c06feada tempest-VolumesSnapshotsTestJSON-666190068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.e8b8e821-5f63-430d-830b-205a0b885115" returned: 0 in 1.002s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-7ce1fe64-3d41-40ba-a121-5629a2a8d8cf req-43f90455-6860-4ea1-8cea-3001c06feada tempest-VolumesSnapshotsTestJSON-666190068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.e8b8e821-5f63-430d-830b-205a0b885115 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:50 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.e8b8e821-5f63-430d-830b-205a0b885115 Jul 10 04:40:50 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:51 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5df8746e-e510-474f-aea9-2d020f1dd901 1073741824" returned: 0 in 1.026s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5df8746e-e510-474f-aea9-2d020f1dd901 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:51 devstack sudo[94907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5df8746e-e510-474f-aea9-2d020f1dd901 Jul 10 04:40:51 devstack sudo[94907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:51 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-676d6fb9-88be-46d3-a9ee-fe0dec7461fe tempest-VolumesActionsTest-1152699420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-120b6584-3427-4992-b370-49831edbe85c" returned: 0 in 0.836s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-676d6fb9-88be-46d3-a9ee-fe0dec7461fe tempest-VolumesActionsTest-1152699420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-120b6584-3427-4992-b370-49831edbe85c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:51 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-120b6584-3427-4992-b370-49831edbe85c Jul 10 04:40:51 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:51 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-7ce1fe64-3d41-40ba-a121-5629a2a8d8cf req-43f90455-6860-4ea1-8cea-3001c06feada tempest-VolumesSnapshotsTestJSON-666190068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38.e8b8e821-5f63-430d-830b-205a0b885115" returned: 0 in 0.871s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-7ce1fe64-3d41-40ba-a121-5629a2a8d8cf req-43f90455-6860-4ea1-8cea-3001c06feada tempest-VolumesSnapshotsTestJSON-666190068 None] Lock "cinder-quobyte-e8b8e821-5f63-430d-830b-205a0b885115" released by "_delete_snapshot" :: held 4.526s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-7ce1fe64-3d41-40ba-a121-5629a2a8d8cf req-43f90455-6860-4ea1-8cea-3001c06feada tempest-VolumesSnapshotsTestJSON-666190068 None] Lock "cinder-quobyte-40026ae0-02da-408a-8edc-3be10382ef38" released by "delete_snapshot" :: held 4.557s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:51 devstack cinder-volume[87359]: DEBUG cinder.quota [req-7ce1fe64-3d41-40ba-a121-5629a2a8d8cf req-43f90455-6860-4ea1-8cea-3001c06feada tempest-VolumesSnapshotsTestJSON-666190068 None] Created reservations ['9a5f4bef-81d2-4d13-af04-50306096c32d', '784307f3-596f-4e3f-a9bf-b2ff5f4436e6', 'a6600fec-27f8-4fc3-ba17-d06a7906b9d3', 'a9d6b4b5-0de6-4e5f-9464-6258b9782d6c'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:51 devstack sudo[94907]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5df8746e-e510-474f-aea9-2d020f1dd901" returned: 0 in 0.805s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:52 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:40:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afacf8af-ca5d-40be-8912-e60d0ac2e7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5df8746e-e510-474f-aea9-2d020f1dd901', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a32a373a-ee32-4e4b-844d-d245af2eb8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:52 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-7ce1fe64-3d41-40ba-a121-5629a2a8d8cf req-43f90455-6860-4ea1-8cea-3001c06feada tempest-VolumesSnapshotsTestJSON-666190068 None] Delete snapshot completed successfully. Jul 10 04:40:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-7ce1fe64-3d41-40ba-a121-5629a2a8d8cf req-43f90455-6860-4ea1-8cea-3001c06feada tempest-VolumesSnapshotsTestJSON-666190068 None] Lock "cinder-e8b8e821-5f63-430d-830b-205a0b885115-delete_snapshot" released by "delete_snapshot" :: held 4.786s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:52 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Volume volume-5df8746e-e510-474f-aea9-2d020f1dd901 (5df8746e-e510-474f-aea9-2d020f1dd901): created successfully Jul 10 04:40:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a32a373a-ee32-4e4b-844d-d245af2eb8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Flow 'volume_create_manager' (e45b0bb8-352f-4243-a4b9-55c77517e55a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:52 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d356a468-0651-4e10-8057-e3a6ef00a988 tempest-TestMinimumBasicScenario-2103618628 None] Created volume successfully. Jul 10 04:40:52 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-676d6fb9-88be-46d3-a9ee-fe0dec7461fe tempest-VolumesActionsTest-1152699420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-120b6584-3427-4992-b370-49831edbe85c" returned: 0 in 0.835s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-676d6fb9-88be-46d3-a9ee-fe0dec7461fe tempest-VolumesActionsTest-1152699420 None] Lock "cinder-quobyte-120b6584-3427-4992-b370-49831edbe85c" released by "delete_volume" :: held 1.731s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:52 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-676d6fb9-88be-46d3-a9ee-fe0dec7461fe tempest-VolumesActionsTest-1152699420 None] Created reservations ['d0e0dd9c-6d38-4336-a1a8-6b77ea3db143', '290971b4-8605-47de-bba3-108c24debb63', '3d6a20c0-022c-479f-a6ea-9748a17166e7', '3de81952-8c70-4f16-8d65-3f759016b05d'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-676d6fb9-88be-46d3-a9ee-fe0dec7461fe tempest-VolumesActionsTest-1152699420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-676d6fb9-88be-46d3-a9ee-fe0dec7461fe tempest-VolumesActionsTest-1152699420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:52 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-676d6fb9-88be-46d3-a9ee-fe0dec7461fe tempest-VolumesActionsTest-1152699420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:52 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-676d6fb9-88be-46d3-a9ee-fe0dec7461fe tempest-VolumesActionsTest-1152699420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-676d6fb9-88be-46d3-a9ee-fe0dec7461fe tempest-VolumesActionsTest-1152699420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-676d6fb9-88be-46d3-a9ee-fe0dec7461fe tempest-VolumesActionsTest-1152699420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:52 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:40:52 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-f6f8ba33-ca6e-4057-91c8-f0648b5a8bc5 req-eae3931d-9ff9-4b1b-a9ce-e40e49c2e868 tempest-VolumesSnapshotsTestJSON-666190068 None] Acquiring lock "cinder-40026ae0-02da-408a-8edc-3be10382ef38-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-f6f8ba33-ca6e-4057-91c8-f0648b5a8bc5 req-eae3931d-9ff9-4b1b-a9ce-e40e49c2e868 tempest-VolumesSnapshotsTestJSON-666190068 None] Lock "cinder-40026ae0-02da-408a-8edc-3be10382ef38-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-f6f8ba33-ca6e-4057-91c8-f0648b5a8bc5 req-eae3931d-9ff9-4b1b-a9ce-e40e49c2e868 tempest-VolumesSnapshotsTestJSON-666190068 None] Acquiring lock "cinder-quobyte-40026ae0-02da-408a-8edc-3be10382ef38" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-f6f8ba33-ca6e-4057-91c8-f0648b5a8bc5 req-eae3931d-9ff9-4b1b-a9ce-e40e49c2e868 tempest-VolumesSnapshotsTestJSON-666190068 None] Lock "cinder-quobyte-40026ae0-02da-408a-8edc-3be10382ef38" acquired by "delete_volume" :: waited 0.037s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:53 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d18c263-74cf-4197-945a-66e931edf09e]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-f6f8ba33-ca6e-4057-91c8-f0648b5a8bc5 req-eae3931d-9ff9-4b1b-a9ce-e40e49c2e868 tempest-VolumesSnapshotsTestJSON-666190068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:53 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-676d6fb9-88be-46d3-a9ee-fe0dec7461fe tempest-VolumesActionsTest-1152699420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.777s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:53 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-676d6fb9-88be-46d3-a9ee-fe0dec7461fe tempest-VolumesActionsTest-1152699420 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:40:53 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-676d6fb9-88be-46d3-a9ee-fe0dec7461fe tempest-VolumesActionsTest-1152699420 None] Deleted volume successfully. Jul 10 04:40:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-676d6fb9-88be-46d3-a9ee-fe0dec7461fe tempest-VolumesActionsTest-1152699420 None] Lock "cinder-120b6584-3427-4992-b370-49831edbe85c-delete_volume" released by "delete_volume" :: held 2.762s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:53 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38 Jul 10 04:40:53 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:54 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-f6f8ba33-ca6e-4057-91c8-f0648b5a8bc5 req-eae3931d-9ff9-4b1b-a9ce-e40e49c2e868 tempest-VolumesSnapshotsTestJSON-666190068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38" returned: 0 in 1.144s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-f6f8ba33-ca6e-4057-91c8-f0648b5a8bc5 req-eae3931d-9ff9-4b1b-a9ce-e40e49c2e868 tempest-VolumesSnapshotsTestJSON-666190068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:54 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38 Jul 10 04:40:54 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:55 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-f6f8ba33-ca6e-4057-91c8-f0648b5a8bc5 req-eae3931d-9ff9-4b1b-a9ce-e40e49c2e868 tempest-VolumesSnapshotsTestJSON-666190068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-40026ae0-02da-408a-8edc-3be10382ef38" returned: 0 in 0.860s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-f6f8ba33-ca6e-4057-91c8-f0648b5a8bc5 req-eae3931d-9ff9-4b1b-a9ce-e40e49c2e868 tempest-VolumesSnapshotsTestJSON-666190068 None] Lock "cinder-quobyte-40026ae0-02da-408a-8edc-3be10382ef38" released by "delete_volume" :: held 2.104s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:55 devstack cinder-volume[87359]: DEBUG cinder.quota [req-f6f8ba33-ca6e-4057-91c8-f0648b5a8bc5 req-eae3931d-9ff9-4b1b-a9ce-e40e49c2e868 tempest-VolumesSnapshotsTestJSON-666190068 None] Created reservations ['9d2102a4-770b-4fd3-83a4-ba45249d6c68', '69b67c2c-0353-416c-9274-7d5f1c2a2b0d', 'a784bd55-d567-443e-84a5-e2bb805eadbf', '542df557-c83f-4812-8118-9e677765d4da'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-f6f8ba33-ca6e-4057-91c8-f0648b5a8bc5 req-eae3931d-9ff9-4b1b-a9ce-e40e49c2e868 tempest-VolumesSnapshotsTestJSON-666190068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-f6f8ba33-ca6e-4057-91c8-f0648b5a8bc5 req-eae3931d-9ff9-4b1b-a9ce-e40e49c2e868 tempest-VolumesSnapshotsTestJSON-666190068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [req-f6f8ba33-ca6e-4057-91c8-f0648b5a8bc5 req-eae3931d-9ff9-4b1b-a9ce-e40e49c2e868 tempest-VolumesSnapshotsTestJSON-666190068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [req-f6f8ba33-ca6e-4057-91c8-f0648b5a8bc5 req-eae3931d-9ff9-4b1b-a9ce-e40e49c2e868 tempest-VolumesSnapshotsTestJSON-666190068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-f6f8ba33-ca6e-4057-91c8-f0648b5a8bc5 req-eae3931d-9ff9-4b1b-a9ce-e40e49c2e868 tempest-VolumesSnapshotsTestJSON-666190068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-f6f8ba33-ca6e-4057-91c8-f0648b5a8bc5 req-eae3931d-9ff9-4b1b-a9ce-e40e49c2e868 tempest-VolumesSnapshotsTestJSON-666190068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:55 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:40:55 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:56 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-f6f8ba33-ca6e-4057-91c8-f0648b5a8bc5 req-eae3931d-9ff9-4b1b-a9ce-e40e49c2e868 tempest-VolumesSnapshotsTestJSON-666190068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.281s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:56 devstack cinder-volume[87359]: DEBUG cinder.manager [req-f6f8ba33-ca6e-4057-91c8-f0648b5a8bc5 req-eae3931d-9ff9-4b1b-a9ce-e40e49c2e868 tempest-VolumesSnapshotsTestJSON-666190068 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:40:56 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-f6f8ba33-ca6e-4057-91c8-f0648b5a8bc5 req-eae3931d-9ff9-4b1b-a9ce-e40e49c2e868 tempest-VolumesSnapshotsTestJSON-666190068 None] Deleted volume successfully. Jul 10 04:40:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-f6f8ba33-ca6e-4057-91c8-f0648b5a8bc5 req-eae3931d-9ff9-4b1b-a9ce-e40e49c2e868 tempest-VolumesSnapshotsTestJSON-666190068 None] Lock "cinder-40026ae0-02da-408a-8edc-3be10382ef38-delete_volume" released by "delete_volume" :: held 3.772s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-6d0b9beb-0e89-4e72-bbbd-7cf7f26b43bd req-20f733c7-4450-42cb-ab25-509409de6ad5 tempest-TestMinimumBasicScenario-2103618628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-6d0b9beb-0e89-4e72-bbbd-7cf7f26b43bd req-20f733c7-4450-42cb-ab25-509409de6ad5 tempest-TestMinimumBasicScenario-2103618628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:56 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d19b7f7-7c45-4d48-953f-887d6c41e6ec]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-6d0b9beb-0e89-4e72-bbbd-7cf7f26b43bd req-20f733c7-4450-42cb-ab25-509409de6ad5 tempest-TestMinimumBasicScenario-2103618628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5df8746e-e510-474f-aea9-2d020f1dd901 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:57 devstack sudo[94947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5df8746e-e510-474f-aea9-2d020f1dd901 Jul 10 04:40:57 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:58 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-6d0b9beb-0e89-4e72-bbbd-7cf7f26b43bd req-20f733c7-4450-42cb-ab25-509409de6ad5 tempest-TestMinimumBasicScenario-2103618628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5df8746e-e510-474f-aea9-2d020f1dd901" returned: 0 in 1.273s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-6d0b9beb-0e89-4e72-bbbd-7cf7f26b43bd req-20f733c7-4450-42cb-ab25-509409de6ad5 tempest-TestMinimumBasicScenario-2103618628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.294s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-6d0b9beb-0e89-4e72-bbbd-7cf7f26b43bd req-20f733c7-4450-42cb-ab25-509409de6ad5 tempest-TestMinimumBasicScenario-2103618628 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31', 'name': 'volume-5df8746e-e510-474f-aea9-2d020f1dd901', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9cf70619-f711-4524-97c0-20e6b8a1a376', 'enforce_multipath': True} {{(pid=87359) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4975}} Jul 10 04:40:58 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-6d0b9beb-0e89-4e72-bbbd-7cf7f26b43bd req-20f733c7-4450-42cb-ab25-509409de6ad5 tempest-TestMinimumBasicScenario-2103618628 None] attachment_update completed successfully. Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Flow 'volume_create_manager' (9614a32b-a984-48ef-b8ce-3d7500574895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dbc6ef8-a70e-4835-bc4b-f6dbb14dbfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dbc6ef8-a70e-4835-bc4b-f6dbb14dbfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-181612552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19b0d46-44a3-46d1-bb2b-b7e5b527f366,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31ad03fb08da435a9b45f3346dc51702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:01Z,use_quota=True,user_id='6003937479d1485fa10cae9ada6f1f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cfcd6e0-9a8f-4e03-a998-1ef17d4dabd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cfcd6e0-9a8f-4e03-a998-1ef17d4dabd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28d6443-43bc-4be3-8221-684744258495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28d6443-43bc-4be3-8221-684744258495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd19b0d46-44a3-46d1-bb2b-b7e5b527f366', 'volume_name': 'volume-d19b0d46-44a3-46d1-bb2b-b7e5b527f366', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ccba4b-b62b-43c0-b3a0-1ba2df47efb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ccba4b-b62b-43c0-b3a0-1ba2df47efb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc02f107-34aa-4631-baa3-e96012afa9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:01 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Volume d19b0d46-44a3-46d1-bb2b-b7e5b527f366: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d19b0d46-44a3-46d1-bb2b-b7e5b527f366', 'volume_size': 1} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-181612552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19b0d46-44a3-46d1-bb2b-b7e5b527f366,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31ad03fb08da435a9b45f3346dc51702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:01Z,use_quota=True,user_id='6003937479d1485fa10cae9ada6f1f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Creating volume d19b0d46-44a3-46d1-bb2b-b7e5b527f366 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:01 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d19b0d46-44a3-46d1-bb2b-b7e5b527f366 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:01 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d19b0d46-44a3-46d1-bb2b-b7e5b527f366 1073741824 Jul 10 04:41:01 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Flow 'volume_create_manager' (3b6eb3d1-14a0-4dc7-b21b-fc8fa29fd1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f43adf-4a1e-49e9-99d5-186fb9bfb242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f43adf-4a1e-49e9-99d5-186fb9bfb242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2051246486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9342fd34-254c-42f0-bf55-c0139f191096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc64a262d2e245679ca6d2c8931dd494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:02Z,use_quota=True,user_id='06ee885b2f614894b4342d027da94b7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f713a34c-689f-473f-937c-64dc74a2294d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f713a34c-689f-473f-937c-64dc74a2294d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e48dca83-3bec-4b1e-a94b-f63da2178556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e48dca83-3bec-4b1e-a94b-f63da2178556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9342fd34-254c-42f0-bf55-c0139f191096', 'volume_name': 'volume-9342fd34-254c-42f0-bf55-c0139f191096', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea22ef31-5736-48d6-b4b5-f6c62c065b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea22ef31-5736-48d6-b4b5-f6c62c065b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (276f7bc4-9f12-4b7a-a55a-f8655423c548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:01 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Volume 9342fd34-254c-42f0-bf55-c0139f191096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9342fd34-254c-42f0-bf55-c0139f191096', 'volume_size': 1} Jul 10 04:41:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:02 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d19b0d46-44a3-46d1-bb2b-b7e5b527f366 1073741824" returned: 0 in 1.024s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d19b0d46-44a3-46d1-bb2b-b7e5b527f366 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:02 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d19b0d46-44a3-46d1-bb2b-b7e5b527f366 Jul 10 04:41:02 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:03 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d19b0d46-44a3-46d1-bb2b-b7e5b527f366" returned: 0 in 0.694s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.491s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2051246486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9342fd34-254c-42f0-bf55-c0139f191096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc64a262d2e245679ca6d2c8931dd494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:02Z,use_quota=True,user_id='06ee885b2f614894b4342d027da94b7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Creating volume 9342fd34-254c-42f0-bf55-c0139f191096 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:03 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:41:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9342fd34-254c-42f0-bf55-c0139f191096 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc02f107-34aa-4631-baa3-e96012afa9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d19b0d46-44a3-46d1-bb2b-b7e5b527f366', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8d3b6ed-8b48-4313-8d48-7c164ce6ad26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:03 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9342fd34-254c-42f0-bf55-c0139f191096 1073741824 Jul 10 04:41:03 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:03 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Volume volume-d19b0d46-44a3-46d1-bb2b-b7e5b527f366 (d19b0d46-44a3-46d1-bb2b-b7e5b527f366): created successfully Jul 10 04:41:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8d3b6ed-8b48-4313-8d48-7c164ce6ad26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Flow 'volume_create_manager' (9614a32b-a984-48ef-b8ce-3d7500574895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:03 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-4ff28be2-4fd0-431f-a57f-9c5b9d90e585 req-a54965ef-8eab-4aa1-a729-626d88b18e70 tempest-VolumesGetTestJSON-579866041 None] Created volume successfully. Jul 10 04:41:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-ec2f108a-bd72-42a2-a273-71eceed97d59 req-a279a9a1-d34a-49dd-a52d-ac92acf065c6 tempest-VolumesGetTestJSON-579866041 None] Acquiring lock "cinder-d19b0d46-44a3-46d1-bb2b-b7e5b527f366-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-ec2f108a-bd72-42a2-a273-71eceed97d59 req-a279a9a1-d34a-49dd-a52d-ac92acf065c6 tempest-VolumesGetTestJSON-579866041 None] Lock "cinder-d19b0d46-44a3-46d1-bb2b-b7e5b527f366-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-ec2f108a-bd72-42a2-a273-71eceed97d59 req-a279a9a1-d34a-49dd-a52d-ac92acf065c6 tempest-VolumesGetTestJSON-579866041 None] Acquiring lock "cinder-quobyte-d19b0d46-44a3-46d1-bb2b-b7e5b527f366" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-ec2f108a-bd72-42a2-a273-71eceed97d59 req-a279a9a1-d34a-49dd-a52d-ac92acf065c6 tempest-VolumesGetTestJSON-579866041 None] Lock "cinder-quobyte-d19b0d46-44a3-46d1-bb2b-b7e5b527f366" acquired by "delete_volume" :: waited 0.022s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:04 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9342fd34-254c-42f0-bf55-c0139f191096 1073741824" returned: 0 in 1.065s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:04 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[487a43e5-e0d7-40d7-8c5f-cd23469ae171]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-ec2f108a-bd72-42a2-a273-71eceed97d59 req-a279a9a1-d34a-49dd-a52d-ac92acf065c6 tempest-VolumesGetTestJSON-579866041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d19b0d46-44a3-46d1-bb2b-b7e5b527f366 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9342fd34-254c-42f0-bf55-c0139f191096 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:04 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9342fd34-254c-42f0-bf55-c0139f191096 Jul 10 04:41:04 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:04 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d19b0d46-44a3-46d1-bb2b-b7e5b527f366 Jul 10 04:41:04 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:05 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9342fd34-254c-42f0-bf55-c0139f191096" returned: 0 in 0.762s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:05 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (276f7bc4-9f12-4b7a-a55a-f8655423c548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9342fd34-254c-42f0-bf55-c0139f191096', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:05 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8aa53bc-7589-4a64-a700-e01edc63302f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:05 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Volume volume-9342fd34-254c-42f0-bf55-c0139f191096 (9342fd34-254c-42f0-bf55-c0139f191096): created successfully Jul 10 04:41:05 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8aa53bc-7589-4a64-a700-e01edc63302f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:05 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Flow 'volume_create_manager' (3b6eb3d1-14a0-4dc7-b21b-fc8fa29fd1c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:05 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-705bdfcb-42f4-463a-8ca8-d2e33f0c20da tempest-AttachVolumeShelveTestJSON-193693134 None] Created volume successfully. Jul 10 04:41:05 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-ec2f108a-bd72-42a2-a273-71eceed97d59 req-a279a9a1-d34a-49dd-a52d-ac92acf065c6 tempest-VolumesGetTestJSON-579866041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d19b0d46-44a3-46d1-bb2b-b7e5b527f366" returned: 0 in 1.047s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-ec2f108a-bd72-42a2-a273-71eceed97d59 req-a279a9a1-d34a-49dd-a52d-ac92acf065c6 tempest-VolumesGetTestJSON-579866041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d19b0d46-44a3-46d1-bb2b-b7e5b527f366 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:05 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d19b0d46-44a3-46d1-bb2b-b7e5b527f366 Jul 10 04:41:05 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:06 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-ec2f108a-bd72-42a2-a273-71eceed97d59 req-a279a9a1-d34a-49dd-a52d-ac92acf065c6 tempest-VolumesGetTestJSON-579866041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d19b0d46-44a3-46d1-bb2b-b7e5b527f366" returned: 0 in 0.813s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-ec2f108a-bd72-42a2-a273-71eceed97d59 req-a279a9a1-d34a-49dd-a52d-ac92acf065c6 tempest-VolumesGetTestJSON-579866041 None] Lock "cinder-quobyte-d19b0d46-44a3-46d1-bb2b-b7e5b527f366" released by "delete_volume" :: held 1.920s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:06 devstack cinder-volume[87359]: DEBUG cinder.quota [req-ec2f108a-bd72-42a2-a273-71eceed97d59 req-a279a9a1-d34a-49dd-a52d-ac92acf065c6 tempest-VolumesGetTestJSON-579866041 None] Created reservations ['6c358b2f-680b-401c-bfb0-da20dde7c51b', '5d1b4b87-d513-40c5-9e7a-193ae5525a15', '6d5e9ba7-e421-43f6-8755-80a590936a2a', 'faa8a6c1-3119-4b60-895e-665e56fedcab'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-ec2f108a-bd72-42a2-a273-71eceed97d59 req-a279a9a1-d34a-49dd-a52d-ac92acf065c6 tempest-VolumesGetTestJSON-579866041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-ec2f108a-bd72-42a2-a273-71eceed97d59 req-a279a9a1-d34a-49dd-a52d-ac92acf065c6 tempest-VolumesGetTestJSON-579866041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [req-ec2f108a-bd72-42a2-a273-71eceed97d59 req-a279a9a1-d34a-49dd-a52d-ac92acf065c6 tempest-VolumesGetTestJSON-579866041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [req-ec2f108a-bd72-42a2-a273-71eceed97d59 req-a279a9a1-d34a-49dd-a52d-ac92acf065c6 tempest-VolumesGetTestJSON-579866041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-ec2f108a-bd72-42a2-a273-71eceed97d59 req-a279a9a1-d34a-49dd-a52d-ac92acf065c6 tempest-VolumesGetTestJSON-579866041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-ec2f108a-bd72-42a2-a273-71eceed97d59 req-a279a9a1-d34a-49dd-a52d-ac92acf065c6 tempest-VolumesGetTestJSON-579866041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:06 devstack sudo[95457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:41:06 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:07 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-ec2f108a-bd72-42a2-a273-71eceed97d59 req-a279a9a1-d34a-49dd-a52d-ac92acf065c6 tempest-VolumesGetTestJSON-579866041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.078s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:07 devstack cinder-volume[87359]: DEBUG cinder.manager [req-ec2f108a-bd72-42a2-a273-71eceed97d59 req-a279a9a1-d34a-49dd-a52d-ac92acf065c6 tempest-VolumesGetTestJSON-579866041 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:07 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-ec2f108a-bd72-42a2-a273-71eceed97d59 req-a279a9a1-d34a-49dd-a52d-ac92acf065c6 tempest-VolumesGetTestJSON-579866041 None] Deleted volume successfully. Jul 10 04:41:07 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-ec2f108a-bd72-42a2-a273-71eceed97d59 req-a279a9a1-d34a-49dd-a52d-ac92acf065c6 tempest-VolumesGetTestJSON-579866041 None] Lock "cinder-d19b0d46-44a3-46d1-bb2b-b7e5b527f366-delete_volume" released by "delete_volume" :: held 3.431s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:10 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Flow 'volume_create_manager' (637a67dd-ca9d-4413-88d9-34f8ba72e90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408370c6-2767-481b-8035-c1773b2b3274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408370c6-2767-481b-8035-c1773b2b3274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-602123092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab0b849-9c2f-4143-9bdc-9dbb14c144d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf9cb0016d8465b891d37decc22f675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:10Z,use_quota=True,user_id='3e7e04586c524933ae63d1fa6dfc96a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bfb72c1-2bd0-4c7b-a8ef-2774c90fcfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bfb72c1-2bd0-4c7b-a8ef-2774c90fcfe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d09ee68-6b3e-4b38-a4bf-85d6784a95a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d09ee68-6b3e-4b38-a4bf-85d6784a95a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bab0b849-9c2f-4143-9bdc-9dbb14c144d3', 'volume_name': 'volume-bab0b849-9c2f-4143-9bdc-9dbb14c144d3', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672fd126-e1f3-4752-9798-0686ae195d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672fd126-e1f3-4752-9798-0686ae195d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e9b940-7aba-4e25-8be1-c3296fae64cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:10 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Volume bab0b849-9c2f-4143-9bdc-9dbb14c144d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bab0b849-9c2f-4143-9bdc-9dbb14c144d3', 'volume_size': 1} Jul 10 04:41:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-602123092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab0b849-9c2f-4143-9bdc-9dbb14c144d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf9cb0016d8465b891d37decc22f675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:10Z,use_quota=True,user_id='3e7e04586c524933ae63d1fa6dfc96a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Creating volume bab0b849-9c2f-4143-9bdc-9dbb14c144d3 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:10 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:41:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bab0b849-9c2f-4143-9bdc-9dbb14c144d3 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:10 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bab0b849-9c2f-4143-9bdc-9dbb14c144d3 1073741824 Jul 10 04:41:10 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:11 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bab0b849-9c2f-4143-9bdc-9dbb14c144d3 1073741824" returned: 0 in 0.972s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:11 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=82,cinder:UPDATE=122,cinder:DELETE=10,cinder:INSERT=26 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:41:11 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=86,cinder:UPDATE=111,cinder:INSERT=28,cinder:DELETE=10 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:41:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bab0b849-9c2f-4143-9bdc-9dbb14c144d3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:11 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bab0b849-9c2f-4143-9bdc-9dbb14c144d3 Jul 10 04:41:11 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:12 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bab0b849-9c2f-4143-9bdc-9dbb14c144d3" returned: 0 in 0.973s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] <== create_volume: return (2021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.024s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e9b940-7aba-4e25-8be1-c3296fae64cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bab0b849-9c2f-4143-9bdc-9dbb14c144d3', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4fe0492-9ef4-44f2-803a-45c7fb574b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:12 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Volume volume-bab0b849-9c2f-4143-9bdc-9dbb14c144d3 (bab0b849-9c2f-4143-9bdc-9dbb14c144d3): created successfully Jul 10 04:41:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4fe0492-9ef4-44f2-803a-45c7fb574b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Flow 'volume_create_manager' (637a67dd-ca9d-4413-88d9-34f8ba72e90a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:12 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-0ec0bb00-9dc7-4c2a-b344-529718728694 tempest-VolumesListAdminTestJSON-1368920526 None] Created volume successfully. Jul 10 04:41:14 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Flow 'volume_create_manager' (da7f5c2e-a27e-4718-b454-6ce9fdf59d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25623d24-6ef4-4b17-947a-3d507fd6f47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25623d24-6ef4-4b17-947a-3d507fd6f47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1483468287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8587ff70-9ed2-4a31-8600-a132f357fd04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf9cb0016d8465b891d37decc22f675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:14Z,use_quota=True,user_id='3e7e04586c524933ae63d1fa6dfc96a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (249bdb24-6071-4755-918b-17624ad67c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (249bdb24-6071-4755-918b-17624ad67c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f621bd2-989c-49c4-bfe3-d8e203699283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f621bd2-989c-49c4-bfe3-d8e203699283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8587ff70-9ed2-4a31-8600-a132f357fd04', 'volume_name': 'volume-8587ff70-9ed2-4a31-8600-a132f357fd04', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed0c76b2-973f-426a-a9cc-34721b339dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed0c76b2-973f-426a-a9cc-34721b339dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb52ad0-eff0-47bf-8b18-715ca0a4ac73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:14 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Volume 8587ff70-9ed2-4a31-8600-a132f357fd04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8587ff70-9ed2-4a31-8600-a132f357fd04', 'volume_size': 1} Jul 10 04:41:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1483468287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8587ff70-9ed2-4a31-8600-a132f357fd04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf9cb0016d8465b891d37decc22f675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:14Z,use_quota=True,user_id='3e7e04586c524933ae63d1fa6dfc96a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Creating volume 8587ff70-9ed2-4a31-8600-a132f357fd04 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:14 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:41:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8587ff70-9ed2-4a31-8600-a132f357fd04 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:14 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8587ff70-9ed2-4a31-8600-a132f357fd04 1073741824 Jul 10 04:41:14 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:15 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8587ff70-9ed2-4a31-8600-a132f357fd04 1073741824" returned: 0 in 1.103s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8587ff70-9ed2-4a31-8600-a132f357fd04 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:15 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8587ff70-9ed2-4a31-8600-a132f357fd04 Jul 10 04:41:15 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:41:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:15 devstack sudo[95517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:41:15 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:16 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8587ff70-9ed2-4a31-8600-a132f357fd04" returned: 0 in 0.916s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:16 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] <== create_volume: return (2064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.068s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb52ad0-eff0-47bf-8b18-715ca0a4ac73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8587ff70-9ed2-4a31-8600-a132f357fd04', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce2cebb-5e89-446b-9bda-ce8ec95b421f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:16 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Volume volume-8587ff70-9ed2-4a31-8600-a132f357fd04 (8587ff70-9ed2-4a31-8600-a132f357fd04): created successfully Jul 10 04:41:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce2cebb-5e89-446b-9bda-ce8ec95b421f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Flow 'volume_create_manager' (da7f5c2e-a27e-4718-b454-6ce9fdf59d4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:16 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d5279380-c4f4-4052-bdbe-9b463e830e30 tempest-VolumesListAdminTestJSON-1368920526 None] Created volume successfully. Jul 10 04:41:16 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.804s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:41:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:41:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:41:17 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Flow 'volume_create_manager' (5193713e-ce17-4aef-a529-7749fc0f6d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7f9e08-b021-4dbe-90e9-7d2aae9fb6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7f9e08-b021-4dbe-90e9-7d2aae9fb6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-389241374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cb3e8c6-db42-4b63-8cdd-70847fbe35b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf9cb0016d8465b891d37decc22f675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:18Z,use_quota=True,user_id='3e7e04586c524933ae63d1fa6dfc96a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdbebc57-42df-409e-a95e-eb24e2aa744f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdbebc57-42df-409e-a95e-eb24e2aa744f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8be747-f3b0-40f6-b13d-640d0f74d2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8be747-f3b0-40f6-b13d-640d0f74d2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cb3e8c6-db42-4b63-8cdd-70847fbe35b6', 'volume_name': 'volume-3cb3e8c6-db42-4b63-8cdd-70847fbe35b6', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d093e8-6d34-4dcb-b8db-c59281c80b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d093e8-6d34-4dcb-b8db-c59281c80b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768589f6-bc7c-482d-ba34-09eb2180aa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:18 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Volume 3cb3e8c6-db42-4b63-8cdd-70847fbe35b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cb3e8c6-db42-4b63-8cdd-70847fbe35b6', 'volume_size': 1} Jul 10 04:41:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-389241374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cb3e8c6-db42-4b63-8cdd-70847fbe35b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf9cb0016d8465b891d37decc22f675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:18Z,use_quota=True,user_id='3e7e04586c524933ae63d1fa6dfc96a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Creating volume 3cb3e8c6-db42-4b63-8cdd-70847fbe35b6 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:18 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:41:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3cb3e8c6-db42-4b63-8cdd-70847fbe35b6 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:18 devstack sudo[95521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3cb3e8c6-db42-4b63-8cdd-70847fbe35b6 1073741824 Jul 10 04:41:18 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:18 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3cb3e8c6-db42-4b63-8cdd-70847fbe35b6 1073741824" returned: 0 in 0.954s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3cb3e8c6-db42-4b63-8cdd-70847fbe35b6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:19 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3cb3e8c6-db42-4b63-8cdd-70847fbe35b6 Jul 10 04:41:19 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:19 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3cb3e8c6-db42-4b63-8cdd-70847fbe35b6" returned: 0 in 0.715s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768589f6-bc7c-482d-ba34-09eb2180aa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cb3e8c6-db42-4b63-8cdd-70847fbe35b6', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d4eac8-3967-4fe7-a2d7-2b3683c40c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:19 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Volume volume-3cb3e8c6-db42-4b63-8cdd-70847fbe35b6 (3cb3e8c6-db42-4b63-8cdd-70847fbe35b6): created successfully Jul 10 04:41:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d4eac8-3967-4fe7-a2d7-2b3683c40c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Flow 'volume_create_manager' (5193713e-ce17-4aef-a529-7749fc0f6d87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:19 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d6cb6367-5a97-44e5-9a84-7120b19c0cda tempest-VolumesListAdminTestJSON-1368920526 None] Created volume successfully. Jul 10 04:41:21 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Flow 'volume_create_manager' (f8f83b6e-c3a2-4fdb-9d7c-25d92cacd455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13652394-4a1c-42f8-b575-27f971d2aaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13652394-4a1c-42f8-b575-27f971d2aaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d5cb0f-48f5-4f1e-8225-b42bb53c523c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bb0e77ca8a47b589ab2faa23066d5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:21Z,use_quota=True,user_id='19c76c795a3d442f824e06b854429257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0151040b-df00-4996-9971-343ee15dc71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0151040b-df00-4996-9971-343ee15dc71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8b57ee-596d-4350-8b28-5a089f666c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8b57ee-596d-4350-8b28-5a089f666c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d5cb0f-48f5-4f1e-8225-b42bb53c523c', 'volume_name': 'volume-76d5cb0f-48f5-4f1e-8225-b42bb53c523c', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e50a79-f576-4aa5-991d-89971049c19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e50a79-f576-4aa5-991d-89971049c19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814d8313-cd89-42e9-a938-35e456e67b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:21 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Volume 76d5cb0f-48f5-4f1e-8225-b42bb53c523c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d5cb0f-48f5-4f1e-8225-b42bb53c523c', 'volume_size': 1} Jul 10 04:41:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d5cb0f-48f5-4f1e-8225-b42bb53c523c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bb0e77ca8a47b589ab2faa23066d5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:21Z,use_quota=True,user_id='19c76c795a3d442f824e06b854429257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Creating volume 76d5cb0f-48f5-4f1e-8225-b42bb53c523c {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:21 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:41:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76d5cb0f-48f5-4f1e-8225-b42bb53c523c 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:21 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76d5cb0f-48f5-4f1e-8225-b42bb53c523c 1073741824 Jul 10 04:41:21 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:22 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76d5cb0f-48f5-4f1e-8225-b42bb53c523c 1073741824" returned: 0 in 1.035s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76d5cb0f-48f5-4f1e-8225-b42bb53c523c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:22 devstack sudo[95581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76d5cb0f-48f5-4f1e-8225-b42bb53c523c Jul 10 04:41:22 devstack sudo[95581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:23 devstack sudo[95581]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76d5cb0f-48f5-4f1e-8225-b42bb53c523c" returned: 0 in 0.837s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] <== create_volume: return (1950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814d8313-cd89-42e9-a938-35e456e67b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d5cb0f-48f5-4f1e-8225-b42bb53c523c', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4030a1f7-2aa1-4b77-9846-a4c360d6d32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-4fd2d2fa-9cd4-46ba-be8e-2cab1b751ea9 req-a035411f-2828-44c9-bf64-a7a4875ff4ec tempest-AttachVolumeShelveTestJSON-193693134 None] No connector for attachment a94d73fb-ac56-4c29-9efb-15b5383c303d; skipping storage backend terminate_connection call. {{(pid=87359) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-4fd2d2fa-9cd4-46ba-be8e-2cab1b751ea9 req-a035411f-2828-44c9-bf64-a7a4875ff4ec tempest-AttachVolumeShelveTestJSON-193693134 None] Deleting attachment a94d73fb-ac56-4c29-9efb-15b5383c303d. {{(pid=87359) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5106}} Jul 10 04:41:23 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Volume volume-76d5cb0f-48f5-4f1e-8225-b42bb53c523c (76d5cb0f-48f5-4f1e-8225-b42bb53c523c): created successfully Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4030a1f7-2aa1-4b77-9846-a4c360d6d32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Flow 'volume_create_manager' (f8f83b6e-c3a2-4fdb-9d7c-25d92cacd455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:23 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-b1618095-a258-4709-b1c0-099d9f88e743 tempest-VolumesListAdminTestJSON-1842902405 None] Created volume successfully. Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Flow 'volume_create_manager' (99788ac9-a54b-4434-939f-1acd95e1a8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241b2c0c-2449-45b4-bdcc-68d57c70e3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241b2c0c-2449-45b4-bdcc-68d57c70e3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1651754754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68293527-e4c8-4736-ac18-12bf854f800b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97a2394398840f891ed59a4800166c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:24Z,use_quota=True,user_id='2735ee0409f14e07b7c5357af3bf7ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48c0fd4-8bea-41af-8278-8da760936760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48c0fd4-8bea-41af-8278-8da760936760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3bad55-c836-4c54-830f-30e2de94e953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3bad55-c836-4c54-830f-30e2de94e953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68293527-e4c8-4736-ac18-12bf854f800b', 'volume_name': 'volume-68293527-e4c8-4736-ac18-12bf854f800b', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8733d544-d192-44ca-802e-7ec19e39616f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8733d544-d192-44ca-802e-7ec19e39616f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aac895f-8c6a-41e6-b933-f2ddede37c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:23 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Volume 68293527-e4c8-4736-ac18-12bf854f800b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68293527-e4c8-4736-ac18-12bf854f800b', 'volume_size': 1} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1651754754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68293527-e4c8-4736-ac18-12bf854f800b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97a2394398840f891ed59a4800166c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:24Z,use_quota=True,user_id='2735ee0409f14e07b7c5357af3bf7ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Creating volume 68293527-e4c8-4736-ac18-12bf854f800b {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:23 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:41:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68293527-e4c8-4736-ac18-12bf854f800b 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:23 devstack sudo[95584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68293527-e4c8-4736-ac18-12bf854f800b 1073741824 Jul 10 04:41:23 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-fdbbb53c-8758-4a63-a830-a8651d4c721a tempest-VolumesListAdminTestJSON-1842902405 None] Acquiring lock "cinder-76d5cb0f-48f5-4f1e-8225-b42bb53c523c-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-fdbbb53c-8758-4a63-a830-a8651d4c721a tempest-VolumesListAdminTestJSON-1842902405 None] Lock "cinder-76d5cb0f-48f5-4f1e-8225-b42bb53c523c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-fdbbb53c-8758-4a63-a830-a8651d4c721a tempest-VolumesListAdminTestJSON-1842902405 None] Acquiring lock "cinder-quobyte-76d5cb0f-48f5-4f1e-8225-b42bb53c523c" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-fdbbb53c-8758-4a63-a830-a8651d4c721a tempest-VolumesListAdminTestJSON-1842902405 None] Lock "cinder-quobyte-76d5cb0f-48f5-4f1e-8225-b42bb53c523c" acquired by "delete_volume" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:24 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0bb066-b05e-4e74-a073-5a9e995be9c3]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fdbbb53c-8758-4a63-a830-a8651d4c721a tempest-VolumesListAdminTestJSON-1842902405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76d5cb0f-48f5-4f1e-8225-b42bb53c523c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0c8a60db-d90e-48d3-8bbb-34d1882dbb26 tempest-VolumesListAdminTestJSON-1368920526 None] Acquiring lock "cinder-3cb3e8c6-db42-4b63-8cdd-70847fbe35b6-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0c8a60db-d90e-48d3-8bbb-34d1882dbb26 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "cinder-3cb3e8c6-db42-4b63-8cdd-70847fbe35b6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:24 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76d5cb0f-48f5-4f1e-8225-b42bb53c523c Jul 10 04:41:24 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0c8a60db-d90e-48d3-8bbb-34d1882dbb26 tempest-VolumesListAdminTestJSON-1368920526 None] Acquiring lock "cinder-quobyte-3cb3e8c6-db42-4b63-8cdd-70847fbe35b6" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0c8a60db-d90e-48d3-8bbb-34d1882dbb26 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "cinder-quobyte-3cb3e8c6-db42-4b63-8cdd-70847fbe35b6" acquired by "delete_volume" :: waited 0.033s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:24 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45d2c77-43d3-4ffb-a865-2281b29b7af5]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0c8a60db-d90e-48d3-8bbb-34d1882dbb26 tempest-VolumesListAdminTestJSON-1368920526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3cb3e8c6-db42-4b63-8cdd-70847fbe35b6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:25 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68293527-e4c8-4736-ac18-12bf854f800b 1073741824" returned: 0 in 1.119s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:25 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3cb3e8c6-db42-4b63-8cdd-70847fbe35b6 Jul 10 04:41:25 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68293527-e4c8-4736-ac18-12bf854f800b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:25 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68293527-e4c8-4736-ac18-12bf854f800b Jul 10 04:41:25 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:25 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fdbbb53c-8758-4a63-a830-a8651d4c721a tempest-VolumesListAdminTestJSON-1842902405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76d5cb0f-48f5-4f1e-8225-b42bb53c523c" returned: 0 in 1.175s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fdbbb53c-8758-4a63-a830-a8651d4c721a tempest-VolumesListAdminTestJSON-1842902405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76d5cb0f-48f5-4f1e-8225-b42bb53c523c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:25 devstack sudo[95628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76d5cb0f-48f5-4f1e-8225-b42bb53c523c Jul 10 04:41:25 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:26 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68293527-e4c8-4736-ac18-12bf854f800b" returned: 0 in 1.010s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] <== create_volume: return (2193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.197s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aac895f-8c6a-41e6-b933-f2ddede37c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68293527-e4c8-4736-ac18-12bf854f800b', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab23aa8-0a12-453e-b422-110991ee03f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:26 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Volume volume-68293527-e4c8-4736-ac18-12bf854f800b (68293527-e4c8-4736-ac18-12bf854f800b): created successfully Jul 10 04:41:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab23aa8-0a12-453e-b422-110991ee03f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Flow 'volume_create_manager' (99788ac9-a54b-4434-939f-1acd95e1a8ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:26 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:26 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d4a41790-86f9-40f6-8f92-adb8fb7a7492 tempest-VolumesServicesTestJSON-2099625884 None] Created volume successfully. Jul 10 04:41:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0c8a60db-d90e-48d3-8bbb-34d1882dbb26 tempest-VolumesListAdminTestJSON-1368920526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3cb3e8c6-db42-4b63-8cdd-70847fbe35b6" returned: 0 in 1.302s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0c8a60db-d90e-48d3-8bbb-34d1882dbb26 tempest-VolumesListAdminTestJSON-1368920526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3cb3e8c6-db42-4b63-8cdd-70847fbe35b6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:26 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3cb3e8c6-db42-4b63-8cdd-70847fbe35b6 Jul 10 04:41:26 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:26 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fdbbb53c-8758-4a63-a830-a8651d4c721a tempest-VolumesListAdminTestJSON-1842902405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76d5cb0f-48f5-4f1e-8225-b42bb53c523c" returned: 0 in 0.923s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:26 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-fdbbb53c-8758-4a63-a830-a8651d4c721a tempest-VolumesListAdminTestJSON-1842902405 None] Lock "cinder-quobyte-76d5cb0f-48f5-4f1e-8225-b42bb53c523c" released by "delete_volume" :: held 2.143s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:26 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-fdbbb53c-8758-4a63-a830-a8651d4c721a tempest-VolumesListAdminTestJSON-1842902405 None] Created reservations ['dcafef92-5151-413f-9503-d53f51ffb4d9', 'a71b411c-4cc2-4332-8b0f-ea9ba807fe83', 'e595630f-6a19-4a5b-87d1-6ed8a231acb8', 'a9d9264e-3346-47e5-ab4b-2693e5871e7e'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fdbbb53c-8758-4a63-a830-a8651d4c721a tempest-VolumesListAdminTestJSON-1842902405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fdbbb53c-8758-4a63-a830-a8651d4c721a tempest-VolumesListAdminTestJSON-1842902405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fdbbb53c-8758-4a63-a830-a8651d4c721a tempest-VolumesListAdminTestJSON-1842902405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fdbbb53c-8758-4a63-a830-a8651d4c721a tempest-VolumesListAdminTestJSON-1842902405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fdbbb53c-8758-4a63-a830-a8651d4c721a tempest-VolumesListAdminTestJSON-1842902405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fdbbb53c-8758-4a63-a830-a8651d4c721a tempest-VolumesListAdminTestJSON-1842902405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:26 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:41:26 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:26 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0c8a60db-d90e-48d3-8bbb-34d1882dbb26 tempest-VolumesListAdminTestJSON-1368920526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3cb3e8c6-db42-4b63-8cdd-70847fbe35b6" returned: 0 in 0.727s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:26 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0c8a60db-d90e-48d3-8bbb-34d1882dbb26 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "cinder-quobyte-3cb3e8c6-db42-4b63-8cdd-70847fbe35b6" released by "delete_volume" :: held 2.086s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:27 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-0c8a60db-d90e-48d3-8bbb-34d1882dbb26 tempest-VolumesListAdminTestJSON-1368920526 None] Created reservations ['fd8a4009-1204-4209-93a0-f5bc40c64e2e', 'd36e84e3-63ff-439c-bb19-42f39a75864f', '1b99b0ad-a66e-48ae-a797-ed5acbbdb42f', '8bd53363-d1fe-4466-92f3-4deba837ec4a'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0c8a60db-d90e-48d3-8bbb-34d1882dbb26 tempest-VolumesListAdminTestJSON-1368920526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0c8a60db-d90e-48d3-8bbb-34d1882dbb26 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-0c8a60db-d90e-48d3-8bbb-34d1882dbb26 tempest-VolumesListAdminTestJSON-1368920526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-0c8a60db-d90e-48d3-8bbb-34d1882dbb26 tempest-VolumesListAdminTestJSON-1368920526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0c8a60db-d90e-48d3-8bbb-34d1882dbb26 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0c8a60db-d90e-48d3-8bbb-34d1882dbb26 tempest-VolumesListAdminTestJSON-1368920526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:27 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:41:27 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-36af3d29-8d0c-44e4-ac34-6239d8567cf3 tempest-VolumesServicesTestJSON-2099625884 None] Acquiring lock "cinder-68293527-e4c8-4736-ac18-12bf854f800b-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-36af3d29-8d0c-44e4-ac34-6239d8567cf3 tempest-VolumesServicesTestJSON-2099625884 None] Lock "cinder-68293527-e4c8-4736-ac18-12bf854f800b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-36af3d29-8d0c-44e4-ac34-6239d8567cf3 tempest-VolumesServicesTestJSON-2099625884 None] Acquiring lock "cinder-quobyte-68293527-e4c8-4736-ac18-12bf854f800b" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-36af3d29-8d0c-44e4-ac34-6239d8567cf3 tempest-VolumesServicesTestJSON-2099625884 None] Lock "cinder-quobyte-68293527-e4c8-4736-ac18-12bf854f800b" acquired by "delete_volume" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:27 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c163768-8494-4a73-800e-0cd77cd956fb]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-36af3d29-8d0c-44e4-ac34-6239d8567cf3 tempest-VolumesServicesTestJSON-2099625884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68293527-e4c8-4736-ac18-12bf854f800b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:27 devstack sudo[95645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68293527-e4c8-4736-ac18-12bf854f800b Jul 10 04:41:27 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:28 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fdbbb53c-8758-4a63-a830-a8651d4c721a tempest-VolumesListAdminTestJSON-1842902405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.151s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:28 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-fdbbb53c-8758-4a63-a830-a8651d4c721a tempest-VolumesListAdminTestJSON-1842902405 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:28 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-fdbbb53c-8758-4a63-a830-a8651d4c721a tempest-VolumesListAdminTestJSON-1842902405 None] Deleted volume successfully. Jul 10 04:41:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-fdbbb53c-8758-4a63-a830-a8651d4c721a tempest-VolumesListAdminTestJSON-1842902405 None] Lock "cinder-76d5cb0f-48f5-4f1e-8225-b42bb53c523c-delete_volume" released by "delete_volume" :: held 3.579s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:28 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0c8a60db-d90e-48d3-8bbb-34d1882dbb26 tempest-VolumesListAdminTestJSON-1368920526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.075s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:28 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-0c8a60db-d90e-48d3-8bbb-34d1882dbb26 tempest-VolumesListAdminTestJSON-1368920526 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:28 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-0c8a60db-d90e-48d3-8bbb-34d1882dbb26 tempest-VolumesListAdminTestJSON-1368920526 None] Deleted volume successfully. Jul 10 04:41:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0c8a60db-d90e-48d3-8bbb-34d1882dbb26 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "cinder-3cb3e8c6-db42-4b63-8cdd-70847fbe35b6-delete_volume" released by "delete_volume" :: held 3.555s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b987fb0b-8dde-4460-923b-15ac2ddeba72 tempest-VolumesListAdminTestJSON-1368920526 None] Acquiring lock "cinder-8587ff70-9ed2-4a31-8600-a132f357fd04-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b987fb0b-8dde-4460-923b-15ac2ddeba72 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "cinder-8587ff70-9ed2-4a31-8600-a132f357fd04-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b987fb0b-8dde-4460-923b-15ac2ddeba72 tempest-VolumesListAdminTestJSON-1368920526 None] Acquiring lock "cinder-quobyte-8587ff70-9ed2-4a31-8600-a132f357fd04" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b987fb0b-8dde-4460-923b-15ac2ddeba72 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "cinder-quobyte-8587ff70-9ed2-4a31-8600-a132f357fd04" acquired by "delete_volume" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:28 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a55dfbd-3958-444d-a933-19b88cabe756]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b987fb0b-8dde-4460-923b-15ac2ddeba72 tempest-VolumesListAdminTestJSON-1368920526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8587ff70-9ed2-4a31-8600-a132f357fd04 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:28 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8587ff70-9ed2-4a31-8600-a132f357fd04 Jul 10 04:41:28 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:28 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-36af3d29-8d0c-44e4-ac34-6239d8567cf3 tempest-VolumesServicesTestJSON-2099625884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68293527-e4c8-4736-ac18-12bf854f800b" returned: 0 in 1.040s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-36af3d29-8d0c-44e4-ac34-6239d8567cf3 tempest-VolumesServicesTestJSON-2099625884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68293527-e4c8-4736-ac18-12bf854f800b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:28 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68293527-e4c8-4736-ac18-12bf854f800b Jul 10 04:41:28 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:29 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b987fb0b-8dde-4460-923b-15ac2ddeba72 tempest-VolumesListAdminTestJSON-1368920526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8587ff70-9ed2-4a31-8600-a132f357fd04" returned: 0 in 0.863s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b987fb0b-8dde-4460-923b-15ac2ddeba72 tempest-VolumesListAdminTestJSON-1368920526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8587ff70-9ed2-4a31-8600-a132f357fd04 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:29 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8587ff70-9ed2-4a31-8600-a132f357fd04 Jul 10 04:41:29 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:29 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-36af3d29-8d0c-44e4-ac34-6239d8567cf3 tempest-VolumesServicesTestJSON-2099625884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68293527-e4c8-4736-ac18-12bf854f800b" returned: 0 in 0.798s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-36af3d29-8d0c-44e4-ac34-6239d8567cf3 tempest-VolumesServicesTestJSON-2099625884 None] Lock "cinder-quobyte-68293527-e4c8-4736-ac18-12bf854f800b" released by "delete_volume" :: held 1.902s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:29 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-36af3d29-8d0c-44e4-ac34-6239d8567cf3 tempest-VolumesServicesTestJSON-2099625884 None] Created reservations ['a9f63c07-7e84-4bd0-964f-f5cb6f3a6b16', '5266143b-9c29-49bf-934f-91feabb7bab5', 'ac2b78f2-d164-4ed7-9b91-298c52f34924', 'e94148d4-6459-4a2b-a919-4a23e830e53b'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-36af3d29-8d0c-44e4-ac34-6239d8567cf3 tempest-VolumesServicesTestJSON-2099625884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-36af3d29-8d0c-44e4-ac34-6239d8567cf3 tempest-VolumesServicesTestJSON-2099625884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-36af3d29-8d0c-44e4-ac34-6239d8567cf3 tempest-VolumesServicesTestJSON-2099625884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-36af3d29-8d0c-44e4-ac34-6239d8567cf3 tempest-VolumesServicesTestJSON-2099625884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-36af3d29-8d0c-44e4-ac34-6239d8567cf3 tempest-VolumesServicesTestJSON-2099625884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-36af3d29-8d0c-44e4-ac34-6239d8567cf3 tempest-VolumesServicesTestJSON-2099625884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:29 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:41:29 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:30 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b987fb0b-8dde-4460-923b-15ac2ddeba72 tempest-VolumesListAdminTestJSON-1368920526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8587ff70-9ed2-4a31-8600-a132f357fd04" returned: 0 in 0.770s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b987fb0b-8dde-4460-923b-15ac2ddeba72 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "cinder-quobyte-8587ff70-9ed2-4a31-8600-a132f357fd04" released by "delete_volume" :: held 1.697s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:30 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-b987fb0b-8dde-4460-923b-15ac2ddeba72 tempest-VolumesListAdminTestJSON-1368920526 None] Created reservations ['5a58a98d-df2a-448a-8290-3bf4106ccd40', 'be640c5e-1c8f-41c3-9328-bab39265a303', '7fbf7c3f-81f2-4d3a-b196-9ecfe8377d09', 'ac02a848-2900-4c29-8227-2559029f2499'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b987fb0b-8dde-4460-923b-15ac2ddeba72 tempest-VolumesListAdminTestJSON-1368920526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b987fb0b-8dde-4460-923b-15ac2ddeba72 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:30 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-b987fb0b-8dde-4460-923b-15ac2ddeba72 tempest-VolumesListAdminTestJSON-1368920526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:30 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-b987fb0b-8dde-4460-923b-15ac2ddeba72 tempest-VolumesListAdminTestJSON-1368920526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b987fb0b-8dde-4460-923b-15ac2ddeba72 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b987fb0b-8dde-4460-923b-15ac2ddeba72 tempest-VolumesListAdminTestJSON-1368920526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:30 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:41:30 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:30 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-36af3d29-8d0c-44e4-ac34-6239d8567cf3 tempest-VolumesServicesTestJSON-2099625884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.035s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:30 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-36af3d29-8d0c-44e4-ac34-6239d8567cf3 tempest-VolumesServicesTestJSON-2099625884 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:30 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-36af3d29-8d0c-44e4-ac34-6239d8567cf3 tempest-VolumesServicesTestJSON-2099625884 None] Deleted volume successfully. Jul 10 04:41:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-36af3d29-8d0c-44e4-ac34-6239d8567cf3 tempest-VolumesServicesTestJSON-2099625884 None] Lock "cinder-68293527-e4c8-4736-ac18-12bf854f800b-delete_volume" released by "delete_volume" :: held 3.258s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c578184-359b-4eab-88d4-427e3a7cae86 tempest-VolumesListAdminTestJSON-1368920526 None] Acquiring lock "cinder-bab0b849-9c2f-4143-9bdc-9dbb14c144d3-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c578184-359b-4eab-88d4-427e3a7cae86 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "cinder-bab0b849-9c2f-4143-9bdc-9dbb14c144d3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c578184-359b-4eab-88d4-427e3a7cae86 tempest-VolumesListAdminTestJSON-1368920526 None] Acquiring lock "cinder-quobyte-bab0b849-9c2f-4143-9bdc-9dbb14c144d3" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c578184-359b-4eab-88d4-427e3a7cae86 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "cinder-quobyte-bab0b849-9c2f-4143-9bdc-9dbb14c144d3" acquired by "delete_volume" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:30 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[5942cb29-6927-4088-8664-ee8b79b2c813]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c578184-359b-4eab-88d4-427e3a7cae86 tempest-VolumesListAdminTestJSON-1368920526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bab0b849-9c2f-4143-9bdc-9dbb14c144d3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:31 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bab0b849-9c2f-4143-9bdc-9dbb14c144d3 Jul 10 04:41:31 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:31 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b987fb0b-8dde-4460-923b-15ac2ddeba72 tempest-VolumesListAdminTestJSON-1368920526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.896s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:31 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-b987fb0b-8dde-4460-923b-15ac2ddeba72 tempest-VolumesListAdminTestJSON-1368920526 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:31 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-b987fb0b-8dde-4460-923b-15ac2ddeba72 tempest-VolumesListAdminTestJSON-1368920526 None] Deleted volume successfully. Jul 10 04:41:31 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b987fb0b-8dde-4460-923b-15ac2ddeba72 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "cinder-8587ff70-9ed2-4a31-8600-a132f357fd04-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:32 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c578184-359b-4eab-88d4-427e3a7cae86 tempest-VolumesListAdminTestJSON-1368920526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bab0b849-9c2f-4143-9bdc-9dbb14c144d3" returned: 0 in 1.172s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c578184-359b-4eab-88d4-427e3a7cae86 tempest-VolumesListAdminTestJSON-1368920526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bab0b849-9c2f-4143-9bdc-9dbb14c144d3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:32 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bab0b849-9c2f-4143-9bdc-9dbb14c144d3 Jul 10 04:41:32 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:32 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c578184-359b-4eab-88d4-427e3a7cae86 tempest-VolumesListAdminTestJSON-1368920526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bab0b849-9c2f-4143-9bdc-9dbb14c144d3" returned: 0 in 0.838s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c578184-359b-4eab-88d4-427e3a7cae86 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "cinder-quobyte-bab0b849-9c2f-4143-9bdc-9dbb14c144d3" released by "delete_volume" :: held 2.087s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:33 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-9c578184-359b-4eab-88d4-427e3a7cae86 tempest-VolumesListAdminTestJSON-1368920526 None] Created reservations ['f6ca9411-adf5-4d90-8fe5-e4c97de44550', 'efa09933-dedd-40aa-a99a-28a6377c1a8e', 'bff6d119-f3bf-448c-a070-fc183aaaa571', '5a2e4a96-1e4e-4ba7-848c-fe73b1a83708'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9c578184-359b-4eab-88d4-427e3a7cae86 tempest-VolumesListAdminTestJSON-1368920526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9c578184-359b-4eab-88d4-427e3a7cae86 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9c578184-359b-4eab-88d4-427e3a7cae86 tempest-VolumesListAdminTestJSON-1368920526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9c578184-359b-4eab-88d4-427e3a7cae86 tempest-VolumesListAdminTestJSON-1368920526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9c578184-359b-4eab-88d4-427e3a7cae86 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c578184-359b-4eab-88d4-427e3a7cae86 tempest-VolumesListAdminTestJSON-1368920526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:33 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:41:33 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:33 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c578184-359b-4eab-88d4-427e3a7cae86 tempest-VolumesListAdminTestJSON-1368920526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.760s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:33 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-9c578184-359b-4eab-88d4-427e3a7cae86 tempest-VolumesListAdminTestJSON-1368920526 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:33 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-9c578184-359b-4eab-88d4-427e3a7cae86 tempest-VolumesListAdminTestJSON-1368920526 None] Deleted volume successfully. Jul 10 04:41:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c578184-359b-4eab-88d4-427e3a7cae86 tempest-VolumesListAdminTestJSON-1368920526 None] Lock "cinder-bab0b849-9c2f-4143-9bdc-9dbb14c144d3-delete_volume" released by "delete_volume" :: held 3.168s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:39 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Flow 'volume_create_manager' (9b4f8bfa-7644-409c-ad35-d349049db8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64e2704-3047-4e2e-92ad-f44678c1dbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64e2704-3047-4e2e-92ad-f44678c1dbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-893089163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dec0c1c-7751-4956-9cc5-3d958a4de38d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd2f3d08cdb439fbbd903370a807eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:39Z,use_quota=True,user_id='d99bb7772c0b4376be663ce1b0e91619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ce2203-ee22-4006-89a3-118c4c0ed27f),volume_type_id=a8ce2203-ee22-4006-89a3-118c4c0ed27f)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b80f40a-9183-4091-8f68-c8a6d10d86f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b80f40a-9183-4091-8f68-c8a6d10d86f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15673eee-bdec-4b9f-bb7d-63dc3f3bc9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15673eee-bdec-4b9f-bb7d-63dc3f3bc9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dec0c1c-7751-4956-9cc5-3d958a4de38d', 'volume_name': 'volume-9dec0c1c-7751-4956-9cc5-3d958a4de38d', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ead53d-0c9c-4a46-8ade-56b16aec6dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ead53d-0c9c-4a46-8ade-56b16aec6dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d39a37-8a41-42ad-a696-22bbb629c856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:39 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Volume 9dec0c1c-7751-4956-9cc5-3d958a4de38d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dec0c1c-7751-4956-9cc5-3d958a4de38d', 'volume_size': 1} Jul 10 04:41:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-893089163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dec0c1c-7751-4956-9cc5-3d958a4de38d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd2f3d08cdb439fbbd903370a807eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:39Z,use_quota=True,user_id='d99bb7772c0b4376be663ce1b0e91619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ce2203-ee22-4006-89a3-118c4c0ed27f),volume_type_id=a8ce2203-ee22-4006-89a3-118c4c0ed27f)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Creating volume 9dec0c1c-7751-4956-9cc5-3d958a4de38d {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:39 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:41:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9dec0c1c-7751-4956-9cc5-3d958a4de38d 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:39 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9dec0c1c-7751-4956-9cc5-3d958a4de38d 1073741824 Jul 10 04:41:39 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:40 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9dec0c1c-7751-4956-9cc5-3d958a4de38d 1073741824" returned: 0 in 1.012s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9dec0c1c-7751-4956-9cc5-3d958a4de38d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:40 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9dec0c1c-7751-4956-9cc5-3d958a4de38d Jul 10 04:41:40 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:41 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9dec0c1c-7751-4956-9cc5-3d958a4de38d" returned: 0 in 0.867s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d39a37-8a41-42ad-a696-22bbb629c856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dec0c1c-7751-4956-9cc5-3d958a4de38d', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af8ffad-1e95-4ae5-a4a1-585c2d9d72a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:41 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Volume volume-9dec0c1c-7751-4956-9cc5-3d958a4de38d (9dec0c1c-7751-4956-9cc5-3d958a4de38d): created successfully Jul 10 04:41:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af8ffad-1e95-4ae5-a4a1-585c2d9d72a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Flow 'volume_create_manager' (9b4f8bfa-7644-409c-ad35-d349049db8ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:41 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-fdc1b77f-53eb-46b7-83d5-ba4a11d2fbcc tempest-VolumeTypesAccessTest-1527811238 None] Created volume successfully. Jul 10 04:41:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f99452b7-c88d-4ddb-abac-fdb9b6cd420c tempest-VolumeTypesAccessTest-1527811238 None] Acquiring lock "cinder-9dec0c1c-7751-4956-9cc5-3d958a4de38d-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f99452b7-c88d-4ddb-abac-fdb9b6cd420c tempest-VolumeTypesAccessTest-1527811238 None] Lock "cinder-9dec0c1c-7751-4956-9cc5-3d958a4de38d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f99452b7-c88d-4ddb-abac-fdb9b6cd420c tempest-VolumeTypesAccessTest-1527811238 None] Acquiring lock "cinder-quobyte-9dec0c1c-7751-4956-9cc5-3d958a4de38d" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f99452b7-c88d-4ddb-abac-fdb9b6cd420c tempest-VolumeTypesAccessTest-1527811238 None] Lock "cinder-quobyte-9dec0c1c-7751-4956-9cc5-3d958a4de38d" acquired by "delete_volume" :: waited 0.028s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:42 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a56787-eed7-497f-9cee-dfc66460a5d7]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f99452b7-c88d-4ddb-abac-fdb9b6cd420c tempest-VolumeTypesAccessTest-1527811238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9dec0c1c-7751-4956-9cc5-3d958a4de38d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:43 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9dec0c1c-7751-4956-9cc5-3d958a4de38d Jul 10 04:41:43 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Flow 'volume_create_manager' (9124e3c7-b95f-43a4-8fff-67136a3852b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e87042c0-0616-423e-a841-2f2a58ffa33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e87042c0-0616-423e-a841-2f2a58ffa33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-357605771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9fefa1-841a-4968-927d-2ae44d559e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d068c9dd695042188ad8a7e344e45cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:43Z,use_quota=True,user_id='8a97c5c295274d8c90b6eb275f6acacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7efa10f6-78e8-4da1-b986-9b6264341f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7efa10f6-78e8-4da1-b986-9b6264341f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9770445-e424-43e2-8875-56ed3ae4f42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9770445-e424-43e2-8875-56ed3ae4f42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd9fefa1-841a-4968-927d-2ae44d559e33', 'volume_name': 'volume-cd9fefa1-841a-4968-927d-2ae44d559e33', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f631ba-2739-4430-9e76-2c2e2afc9870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f631ba-2739-4430-9e76-2c2e2afc9870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e4a9db-2f8a-4fec-8350-f8d6962f5465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:43 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Volume cd9fefa1-841a-4968-927d-2ae44d559e33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd9fefa1-841a-4968-927d-2ae44d559e33', 'volume_size': 1} Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-357605771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9fefa1-841a-4968-927d-2ae44d559e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d068c9dd695042188ad8a7e344e45cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:43Z,use_quota=True,user_id='8a97c5c295274d8c90b6eb275f6acacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Creating volume cd9fefa1-841a-4968-927d-2ae44d559e33 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:43 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:43 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33 1073741824 Jul 10 04:41:43 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:43 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f99452b7-c88d-4ddb-abac-fdb9b6cd420c tempest-VolumeTypesAccessTest-1527811238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9dec0c1c-7751-4956-9cc5-3d958a4de38d" returned: 0 in 1.101s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f99452b7-c88d-4ddb-abac-fdb9b6cd420c tempest-VolumeTypesAccessTest-1527811238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9dec0c1c-7751-4956-9cc5-3d958a4de38d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:43 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9dec0c1c-7751-4956-9cc5-3d958a4de38d Jul 10 04:41:43 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:44 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33 1073741824" returned: 0 in 0.947s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:44 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33 Jul 10 04:41:44 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:44 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f99452b7-c88d-4ddb-abac-fdb9b6cd420c tempest-VolumeTypesAccessTest-1527811238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9dec0c1c-7751-4956-9cc5-3d958a4de38d" returned: 0 in 0.694s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:44 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f99452b7-c88d-4ddb-abac-fdb9b6cd420c tempest-VolumeTypesAccessTest-1527811238 None] Lock "cinder-quobyte-9dec0c1c-7751-4956-9cc5-3d958a4de38d" released by "delete_volume" :: held 1.865s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:44 devstack cinder-volume[87359]: WARNING cinder.quota [None req-f99452b7-c88d-4ddb-abac-fdb9b6cd420c tempest-VolumeTypesAccessTest-1527811238 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-951419395 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-951419395, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:41:44 devstack cinder-volume[87359]: WARNING cinder.quota [None req-f99452b7-c88d-4ddb-abac-fdb9b6cd420c tempest-VolumeTypesAccessTest-1527811238 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-951419395 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-951419395, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:41:44 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-f99452b7-c88d-4ddb-abac-fdb9b6cd420c tempest-VolumeTypesAccessTest-1527811238 None] Created reservations ['74474521-8aea-448b-8635-ba76ccc27937', '190867ce-35d3-4d1e-ad02-97c51093cd08', '8be8d721-c7e2-4a4c-a42f-ad14ca0791b6', '0049a20e-c4b3-497a-8afe-9157766debe1'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f99452b7-c88d-4ddb-abac-fdb9b6cd420c tempest-VolumeTypesAccessTest-1527811238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f99452b7-c88d-4ddb-abac-fdb9b6cd420c tempest-VolumeTypesAccessTest-1527811238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f99452b7-c88d-4ddb-abac-fdb9b6cd420c tempest-VolumeTypesAccessTest-1527811238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f99452b7-c88d-4ddb-abac-fdb9b6cd420c tempest-VolumeTypesAccessTest-1527811238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f99452b7-c88d-4ddb-abac-fdb9b6cd420c tempest-VolumeTypesAccessTest-1527811238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f99452b7-c88d-4ddb-abac-fdb9b6cd420c tempest-VolumeTypesAccessTest-1527811238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:44 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:41:44 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:45 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33" returned: 0 in 0.917s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:45 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:45 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e4a9db-2f8a-4fec-8350-f8d6962f5465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd9fefa1-841a-4968-927d-2ae44d559e33', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:45 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d105e8-2e34-4319-8a7c-accd2f6e202a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:45 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Volume volume-cd9fefa1-841a-4968-927d-2ae44d559e33 (cd9fefa1-841a-4968-927d-2ae44d559e33): created successfully Jul 10 04:41:45 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d105e8-2e34-4319-8a7c-accd2f6e202a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:45 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Flow 'volume_create_manager' (9124e3c7-b95f-43a4-8fff-67136a3852b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:45 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-1a416999-0a4f-4c90-9420-a8e38959b9ff tempest-VolumeDependencyTests-280830217 None] Created volume successfully. Jul 10 04:41:45 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f99452b7-c88d-4ddb-abac-fdb9b6cd420c tempest-VolumeTypesAccessTest-1527811238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.916s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:45 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-f99452b7-c88d-4ddb-abac-fdb9b6cd420c tempest-VolumeTypesAccessTest-1527811238 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:45 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-f99452b7-c88d-4ddb-abac-fdb9b6cd420c tempest-VolumeTypesAccessTest-1527811238 None] Deleted volume successfully. Jul 10 04:41:45 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f99452b7-c88d-4ddb-abac-fdb9b6cd420c tempest-VolumeTypesAccessTest-1527811238 None] Lock "cinder-9dec0c1c-7751-4956-9cc5-3d958a4de38d-delete_volume" released by "delete_volume" :: held 3.052s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-70556468-dc7f-4582-8674-1a6f7b591581 tempest-VolumeDependencyTests-280830217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-70556468-dc7f-4582-8674-1a6f7b591581 tempest-VolumeDependencyTests-280830217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-70556468-dc7f-4582-8674-1a6f7b591581 tempest-VolumeDependencyTests-280830217 None] Creating offline snapshot 8b833445-87b0-4a76-b5cc-f19079edf879 of volume cd9fefa1-841a-4968-927d-2ae44d559e33 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:41:46 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[588ed74e-fe44-40c1-9471-a3a5718315d5]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70556468-dc7f-4582-8674-1a6f7b591581 tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:47 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33 Jul 10 04:41:47 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:47 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70556468-dc7f-4582-8674-1a6f7b591581 tempest-VolumeDependencyTests-280830217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33" returned: 0 in 1.036s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70556468-dc7f-4582-8674-1a6f7b591581 tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:47 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879 1G Jul 10 04:41:47 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:48 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70556468-dc7f-4582-8674-1a6f7b591581 tempest-VolumeDependencyTests-280830217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879 1G" returned: 0 in 1.011s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70556468-dc7f-4582-8674-1a6f7b591581 tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd9fefa1-841a-4968-927d-2ae44d559e33 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:48 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd9fefa1-841a-4968-927d-2ae44d559e33 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879 Jul 10 04:41:48 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:49 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70556468-dc7f-4582-8674-1a6f7b591581 tempest-VolumeDependencyTests-280830217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd9fefa1-841a-4968-927d-2ae44d559e33 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879" returned: 0 in 0.875s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:49 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-70556468-dc7f-4582-8674-1a6f7b591581 tempest-VolumeDependencyTests-280830217 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879 is being set with open permissions: ugo+rw Jul 10 04:41:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70556468-dc7f-4582-8674-1a6f7b591581 tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:49 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879 Jul 10 04:41:49 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:50 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70556468-dc7f-4582-8674-1a6f7b591581 tempest-VolumeDependencyTests-280830217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879" returned: 0 in 0.973s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70556468-dc7f-4582-8674-1a6f7b591581 tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:50 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.info Jul 10 04:41:50 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:52 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70556468-dc7f-4582-8674-1a6f7b591581 tempest-VolumeDependencyTests-280830217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.info" returned: 0 in 1.243s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:52 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-70556468-dc7f-4582-8674-1a6f7b591581 tempest-VolumeDependencyTests-280830217 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.info is being set with open permissions: ugo+rw Jul 10 04:41:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70556468-dc7f-4582-8674-1a6f7b591581 tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:52 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.info Jul 10 04:41:52 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:53 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70556468-dc7f-4582-8674-1a6f7b591581 tempest-VolumeDependencyTests-280830217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.info" returned: 0 in 0.899s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-70556468-dc7f-4582-8674-1a6f7b591581 tempest-VolumeDependencyTests-280830217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.242s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:53 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-70556468-dc7f-4582-8674-1a6f7b591581 tempest-VolumeDependencyTests-280830217 None] Create snapshot completed successfully Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Flow 'volume_create_manager' (092582a1-2fa8-44af-856e-0e1e9a71ad00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f76b8d64-ee69-4e73-80ef-a624a6eae8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f76b8d64-ee69-4e73-80ef-a624a6eae8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-17601908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f928c22a-c962-419a-990a-c2a30c12df09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d068c9dd695042188ad8a7e344e45cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8b833445-87b0-4a76-b5cc-f19079edf879,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:54Z,use_quota=True,user_id='8a97c5c295274d8c90b6eb275f6acacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4bb7be-7310-4ab5-a3be-494c48059800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4bb7be-7310-4ab5-a3be-494c48059800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef50ce29-6a00-44d7-b030-d7b72b6520bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef50ce29-6a00-44d7-b030-d7b72b6520bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f928c22a-c962-419a-990a-c2a30c12df09', 'volume_name': 'volume-f928c22a-c962-419a-990a-c2a30c12df09', 'volume_size': 1, 'snapshot_id': '8b833445-87b0-4a76-b5cc-f19079edf879'}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42750ca-a40b-4e53-a63f-fa2239f62bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42750ca-a40b-4e53-a63f-fa2239f62bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc2dcf4-b68b-4fac-a6f5-e2bb4c62f60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:54 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Volume f928c22a-c962-419a-990a-c2a30c12df09: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f928c22a-c962-419a-990a-c2a30c12df09', 'volume_size': 1, 'snapshot_id': '8b833445-87b0-4a76-b5cc-f19079edf879'} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Acquiring lock "cinder-quobyte-8b833445-87b0-4a76-b5cc-f19079edf879-f928c22a-c962-419a-990a-c2a30c12df09" by "_create_volume_from_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Lock "cinder-quobyte-8b833445-87b0-4a76-b5cc-f19079edf879-f928c22a-c962-419a-990a-c2a30c12df09" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Creating volume f928c22a-c962-419a-990a-c2a30c12df09 from snapshot 8b833445-87b0-4a76-b5cc-f19079edf879 {{(pid=87359) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Acquiring lock "cinder-quobyte-f928c22a-c962-419a-990a-c2a30c12df09" by "_copy_volume_from_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Lock "cinder-quobyte-f928c22a-c962-419a-990a-c2a30c12df09" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] snapshot: 8b833445-87b0-4a76-b5cc-f19079edf879, volume: f928c22a-c962-419a-990a-c2a30c12df09, {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5fb459-7e9f-4234-b0bb-7f189fac3b42]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:54 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-2c9aa799-293d-45d3-95da-50c816668125 req-98fcfaab-6905-4463-b226-d0153475ec45 tempest-TestMinimumBasicScenario-2103618628 None] Terminate volume connection completed successfully. Jul 10 04:41:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-2c9aa799-293d-45d3-95da-50c816668125 req-98fcfaab-6905-4463-b226-d0153475ec45 tempest-TestMinimumBasicScenario-2103618628 None] Deleting attachment 9cf70619-f711-4524-97c0-20e6b8a1a376. {{(pid=87359) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5106}} Jul 10 04:41:54 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879 Jul 10 04:41:54 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:55 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879" returned: 0 in 0.870s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd9fefa1-841a-4968-927d-2ae44d559e33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:41:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33 {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 04:41:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Creating direct copy from snapshot {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 04:41:55 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09a31c1-d612-45ba-98f3-c82bd26512af]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:55 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33 Jul 10 04:41:55 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:56 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33" returned: 0 in 0.977s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:56 devstack cinder-volume[87359]: DEBUG cinder.utils [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Path /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f928c22a-c962-419a-990a-c2a30c12df09 not found in is_blk_device check {{(pid=87359) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 04:41:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f928c22a-c962-419a-990a-c2a30c12df09 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:56 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f928c22a-c962-419a-990a-c2a30c12df09 Jul 10 04:41:56 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2290c4a0-0c4d-44cd-ac7d-3503d48fae46 tempest-TestMinimumBasicScenario-2103618628 None] Acquiring lock "cinder-5df8746e-e510-474f-aea9-2d020f1dd901-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2290c4a0-0c4d-44cd-ac7d-3503d48fae46 tempest-TestMinimumBasicScenario-2103618628 None] Lock "cinder-5df8746e-e510-474f-aea9-2d020f1dd901-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2290c4a0-0c4d-44cd-ac7d-3503d48fae46 tempest-TestMinimumBasicScenario-2103618628 None] Acquiring lock "cinder-quobyte-5df8746e-e510-474f-aea9-2d020f1dd901" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2290c4a0-0c4d-44cd-ac7d-3503d48fae46 tempest-TestMinimumBasicScenario-2103618628 None] Lock "cinder-quobyte-5df8746e-e510-474f-aea9-2d020f1dd901" acquired by "delete_volume" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:56 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[23799566-2418-4b74-809a-e1175448e852]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2290c4a0-0c4d-44cd-ac7d-3503d48fae46 tempest-TestMinimumBasicScenario-2103618628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5df8746e-e510-474f-aea9-2d020f1dd901 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:56 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5df8746e-e510-474f-aea9-2d020f1dd901 Jul 10 04:41:56 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:58 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2290c4a0-0c4d-44cd-ac7d-3503d48fae46 tempest-TestMinimumBasicScenario-2103618628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5df8746e-e510-474f-aea9-2d020f1dd901" returned: 0 in 1.756s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2290c4a0-0c4d-44cd-ac7d-3503d48fae46 tempest-TestMinimumBasicScenario-2103618628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5df8746e-e510-474f-aea9-2d020f1dd901 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:58 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5df8746e-e510-474f-aea9-2d020f1dd901 Jul 10 04:41:58 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:00 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2290c4a0-0c4d-44cd-ac7d-3503d48fae46 tempest-TestMinimumBasicScenario-2103618628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5df8746e-e510-474f-aea9-2d020f1dd901" returned: 0 in 2.035s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:00 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2290c4a0-0c4d-44cd-ac7d-3503d48fae46 tempest-TestMinimumBasicScenario-2103618628 None] Lock "cinder-quobyte-5df8746e-e510-474f-aea9-2d020f1dd901" released by "delete_volume" :: held 3.892s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:00 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-2290c4a0-0c4d-44cd-ac7d-3503d48fae46 tempest-TestMinimumBasicScenario-2103618628 None] Created reservations ['727e1c62-d720-412a-bcb1-7d697b781509', '3b475631-ec7f-4ae6-b590-e467a42242ca', 'e8b5026d-323a-49df-a93c-8201cfc92bd6', '64778a10-ca9a-4173-966f-5bb858075f2c'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2290c4a0-0c4d-44cd-ac7d-3503d48fae46 tempest-TestMinimumBasicScenario-2103618628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2290c4a0-0c4d-44cd-ac7d-3503d48fae46 tempest-TestMinimumBasicScenario-2103618628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2290c4a0-0c4d-44cd-ac7d-3503d48fae46 tempest-TestMinimumBasicScenario-2103618628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2290c4a0-0c4d-44cd-ac7d-3503d48fae46 tempest-TestMinimumBasicScenario-2103618628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2290c4a0-0c4d-44cd-ac7d-3503d48fae46 tempest-TestMinimumBasicScenario-2103618628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2290c4a0-0c4d-44cd-ac7d-3503d48fae46 tempest-TestMinimumBasicScenario-2103618628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:01 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:42:01 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:02 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2290c4a0-0c4d-44cd-ac7d-3503d48fae46 tempest-TestMinimumBasicScenario-2103618628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.737s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:02 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-2290c4a0-0c4d-44cd-ac7d-3503d48fae46 tempest-TestMinimumBasicScenario-2103618628 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:02 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-2290c4a0-0c4d-44cd-ac7d-3503d48fae46 tempest-TestMinimumBasicScenario-2103618628 None] Deleted volume successfully. Jul 10 04:42:02 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2290c4a0-0c4d-44cd-ac7d-3503d48fae46 tempest-TestMinimumBasicScenario-2103618628 None] Lock "cinder-5df8746e-e510-474f-aea9-2d020f1dd901-delete_volume" released by "delete_volume" :: held 6.170s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:03 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f928c22a-c962-419a-990a-c2a30c12df09" returned: 0 in 7.137s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:03 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6a518d-3faa-459b-9f38-a0449eab999e]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:03 devstack sudo[95943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33 Jul 10 04:42:03 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:03 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:42:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Flow 'volume_create_manager' (76eb0e90-c010-4dcb-a657-1152f80ec467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb1b9cd-14ac-43a5-849e-2720f5d208dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb1b9cd-14ac-43a5-849e-2720f5d208dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-982556802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b927ad-40ad-459f-89b4-095728806382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67905b7193a044feb9b7c037fe4808c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:04Z,use_quota=True,user_id='73dbb265c9b64758901a4558c6a69347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841b05bb-8f77-47da-8a94-52f22758ba2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841b05bb-8f77-47da-8a94-52f22758ba2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7c7e0d-4593-4be5-b6fe-ce060ab949ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7c7e0d-4593-4be5-b6fe-ce060ab949ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b927ad-40ad-459f-89b4-095728806382', 'volume_name': 'volume-b6b927ad-40ad-459f-89b4-095728806382', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a6e5cb-0c9b-42ce-8b3d-3bd5fd79a913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a6e5cb-0c9b-42ce-8b3d-3bd5fd79a913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a60532-62a1-4a60-81e6-3be80a616a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:04 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Volume b6b927ad-40ad-459f-89b4-095728806382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b927ad-40ad-459f-89b4-095728806382', 'volume_size': 1} Jul 10 04:42:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:04 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33" returned: 0 in 1.263s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:04 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33, size 1024.00 MB, duration 7.14 sec, destination /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f928c22a-c962-419a-990a-c2a30c12df09 {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:42:04 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Converted 1024.00 MB image at 143.45 MB/s Jul 10 04:42:04 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f928c22a-c962-419a-990a-c2a30c12df09 is being set with open permissions: ugo+rw Jul 10 04:42:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f928c22a-c962-419a-990a-c2a30c12df09 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:04 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f928c22a-c962-419a-990a-c2a30c12df09 Jul 10 04:42:04 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:05 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f928c22a-c962-419a-990a-c2a30c12df09" returned: 0 in 0.707s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Lock "cinder-quobyte-f928c22a-c962-419a-990a-c2a30c12df09" released by "_copy_volume_from_snapshot" :: held 11.102s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Lock "cinder-quobyte-8b833445-87b0-4a76-b5cc-f19079edf879-f928c22a-c962-419a-990a-c2a30c12df09" released by "_create_volume_from_snapshot" :: held 11.145s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.167s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.224s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-982556802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b927ad-40ad-459f-89b4-095728806382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67905b7193a044feb9b7c037fe4808c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:04Z,use_quota=True,user_id='73dbb265c9b64758901a4558c6a69347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:42:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Creating volume b6b927ad-40ad-459f-89b4-095728806382 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:42:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:42:05 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:42:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:05 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382 1073741824 Jul 10 04:42:05 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:05 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc2dcf4-b68b-4fac-a6f5-e2bb4c62f60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f928c22a-c962-419a-990a-c2a30c12df09', 'volume_size': 1, 'snapshot_id': '8b833445-87b0-4a76-b5cc-f19079edf879'}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:05 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b32ee98-5ce2-4636-8311-69133e7cc8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:05 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Volume volume-f928c22a-c962-419a-990a-c2a30c12df09 (f928c22a-c962-419a-990a-c2a30c12df09): created successfully Jul 10 04:42:05 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b32ee98-5ce2-4636-8311-69133e7cc8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:05 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Flow 'volume_create_manager' (092582a1-2fa8-44af-856e-0e1e9a71ad00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:05 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-25901b64-2ada-4105-95a7-ada464eda2a4 tempest-VolumeDependencyTests-280830217 None] Created volume successfully. Jul 10 04:42:06 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382 1073741824" returned: 0 in 0.840s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:06 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382 Jul 10 04:42:06 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e9e2f3cb-cd4a-470e-ae8f-10085d85d84c tempest-VolumeDependencyTests-280830217 None] Acquiring lock "cinder-8b833445-87b0-4a76-b5cc-f19079edf879-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e9e2f3cb-cd4a-470e-ae8f-10085d85d84c tempest-VolumeDependencyTests-280830217 None] Lock "cinder-8b833445-87b0-4a76-b5cc-f19079edf879-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e9e2f3cb-cd4a-470e-ae8f-10085d85d84c tempest-VolumeDependencyTests-280830217 None] Acquiring lock "cinder-quobyte-cd9fefa1-841a-4968-927d-2ae44d559e33" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e9e2f3cb-cd4a-470e-ae8f-10085d85d84c tempest-VolumeDependencyTests-280830217 None] Lock "cinder-quobyte-cd9fefa1-841a-4968-927d-2ae44d559e33" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e9e2f3cb-cd4a-470e-ae8f-10085d85d84c tempest-VolumeDependencyTests-280830217 None] Acquiring lock "cinder-quobyte-8b833445-87b0-4a76-b5cc-f19079edf879" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e9e2f3cb-cd4a-470e-ae8f-10085d85d84c tempest-VolumeDependencyTests-280830217 None] Lock "cinder-quobyte-8b833445-87b0-4a76-b5cc-f19079edf879" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-e9e2f3cb-cd4a-470e-ae8f-10085d85d84c tempest-VolumeDependencyTests-280830217 None] Deleting offline snapshot 8b833445-87b0-4a76-b5cc-f19079edf879 of volume cd9fefa1-841a-4968-927d-2ae44d559e33 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:42:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-e9e2f3cb-cd4a-470e-ae8f-10085d85d84c tempest-VolumeDependencyTests-280830217 None] snapshot_file for this snap is: volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:42:06 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b07940-046f-4fe6-809f-9ad5eef7b347]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e9e2f3cb-cd4a-470e-ae8f-10085d85d84c tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:06 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879 Jul 10 04:42:06 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:06 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382" returned: 0 in 0.736s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:42:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a60532-62a1-4a60-81e6-3be80a616a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b927ad-40ad-459f-89b4-095728806382', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31692549-2adf-49db-9065-553ac1e5b904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:06 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Volume volume-b6b927ad-40ad-459f-89b4-095728806382 (b6b927ad-40ad-459f-89b4-095728806382): created successfully Jul 10 04:42:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31692549-2adf-49db-9065-553ac1e5b904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Flow 'volume_create_manager' (76eb0e90-c010-4dcb-a657-1152f80ec467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:07 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-f19a4188-5d97-4491-992e-96e4cc250700 tempest-SnapshotMetadataTestJSON-470499139 None] Created volume successfully. Jul 10 04:42:07 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e9e2f3cb-cd4a-470e-ae8f-10085d85d84c tempest-VolumeDependencyTests-280830217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879" returned: 0 in 0.815s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-e9e2f3cb-cd4a-470e-ae8f-10085d85d84c tempest-VolumeDependencyTests-280830217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd9fefa1-841a-4968-927d-2ae44d559e33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:42:07 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83f81ab-1e4e-49d1-9095-234b79495b54]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e9e2f3cb-cd4a-470e-ae8f-10085d85d84c tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:07 devstack sudo[95994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33 Jul 10 04:42:07 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:08 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e9e2f3cb-cd4a-470e-ae8f-10085d85d84c tempest-VolumeDependencyTests-280830217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33" returned: 0 in 0.812s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e9e2f3cb-cd4a-470e-ae8f-10085d85d84c tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:08 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879 Jul 10 04:42:08 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a376c206-f69d-45e2-9ed8-374c1376fb53 tempest-SnapshotMetadataTestJSON-470499139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a376c206-f69d-45e2-9ed8-374c1376fb53 tempest-SnapshotMetadataTestJSON-470499139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a376c206-f69d-45e2-9ed8-374c1376fb53 tempest-SnapshotMetadataTestJSON-470499139 None] Creating offline snapshot 822a7c60-b39b-4131-9de0-6126c70dea92 of volume b6b927ad-40ad-459f-89b4-095728806382 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:42:08 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a417455-1fd2-4b1b-a917-fcc5331c3322]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a376c206-f69d-45e2-9ed8-374c1376fb53 tempest-SnapshotMetadataTestJSON-470499139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:08 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382 Jul 10 04:42:08 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:08 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e9e2f3cb-cd4a-470e-ae8f-10085d85d84c tempest-VolumeDependencyTests-280830217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879" returned: 0 in 0.903s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e9e2f3cb-cd4a-470e-ae8f-10085d85d84c tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:09 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879 Jul 10 04:42:09 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:09 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a376c206-f69d-45e2-9ed8-374c1376fb53 tempest-SnapshotMetadataTestJSON-470499139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382" returned: 0 in 0.880s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a376c206-f69d-45e2-9ed8-374c1376fb53 tempest-SnapshotMetadataTestJSON-470499139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.822a7c60-b39b-4131-9de0-6126c70dea92 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:09 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.822a7c60-b39b-4131-9de0-6126c70dea92 1G Jul 10 04:42:09 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:09 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e9e2f3cb-cd4a-470e-ae8f-10085d85d84c tempest-VolumeDependencyTests-280830217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33.8b833445-87b0-4a76-b5cc-f19079edf879" returned: 0 in 0.683s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:09 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e9e2f3cb-cd4a-470e-ae8f-10085d85d84c tempest-VolumeDependencyTests-280830217 None] Lock "cinder-quobyte-8b833445-87b0-4a76-b5cc-f19079edf879" released by "_delete_snapshot" :: held 3.344s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:09 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e9e2f3cb-cd4a-470e-ae8f-10085d85d84c tempest-VolumeDependencyTests-280830217 None] Lock "cinder-quobyte-cd9fefa1-841a-4968-927d-2ae44d559e33" released by "delete_snapshot" :: held 3.391s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:09 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-e9e2f3cb-cd4a-470e-ae8f-10085d85d84c tempest-VolumeDependencyTests-280830217 None] Created reservations ['b118ed36-d5bc-4e7e-be70-bae7149da1d7', 'd5e2802b-0b1a-42b9-b8e9-d89b6fbd3e98', '9cf3e34b-eac9-4f78-8f7f-f08d8382627c', '9d6d45cb-6b4e-4ffa-9125-d003a24e58c7'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:09 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-e9e2f3cb-cd4a-470e-ae8f-10085d85d84c tempest-VolumeDependencyTests-280830217 None] Delete snapshot completed successfully. Jul 10 04:42:09 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e9e2f3cb-cd4a-470e-ae8f-10085d85d84c tempest-VolumeDependencyTests-280830217 None] Lock "cinder-8b833445-87b0-4a76-b5cc-f19079edf879-delete_snapshot" released by "delete_snapshot" :: held 3.621s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:10 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a376c206-f69d-45e2-9ed8-374c1376fb53 tempest-SnapshotMetadataTestJSON-470499139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.822a7c60-b39b-4131-9de0-6126c70dea92 1G" returned: 0 in 1.025s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a376c206-f69d-45e2-9ed8-374c1376fb53 tempest-SnapshotMetadataTestJSON-470499139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b927ad-40ad-459f-89b4-095728806382 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.822a7c60-b39b-4131-9de0-6126c70dea92 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:10 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b927ad-40ad-459f-89b4-095728806382 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.822a7c60-b39b-4131-9de0-6126c70dea92 Jul 10 04:42:10 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c7f0663f-8137-4ae9-ac61-ed1ee60e3f6a tempest-VolumeDependencyTests-280830217 None] Acquiring lock "cinder-cd9fefa1-841a-4968-927d-2ae44d559e33-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c7f0663f-8137-4ae9-ac61-ed1ee60e3f6a tempest-VolumeDependencyTests-280830217 None] Lock "cinder-cd9fefa1-841a-4968-927d-2ae44d559e33-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c7f0663f-8137-4ae9-ac61-ed1ee60e3f6a tempest-VolumeDependencyTests-280830217 None] Acquiring lock "cinder-quobyte-cd9fefa1-841a-4968-927d-2ae44d559e33" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c7f0663f-8137-4ae9-ac61-ed1ee60e3f6a tempest-VolumeDependencyTests-280830217 None] Lock "cinder-quobyte-cd9fefa1-841a-4968-927d-2ae44d559e33" acquired by "delete_volume" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:10 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0a6193-1e03-421f-b120-a30289a30bf7]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c7f0663f-8137-4ae9-ac61-ed1ee60e3f6a tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:10 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33 Jul 10 04:42:10 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:11 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a376c206-f69d-45e2-9ed8-374c1376fb53 tempest-SnapshotMetadataTestJSON-470499139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b927ad-40ad-459f-89b4-095728806382 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.822a7c60-b39b-4131-9de0-6126c70dea92" returned: 0 in 0.919s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:11 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-a376c206-f69d-45e2-9ed8-374c1376fb53 tempest-SnapshotMetadataTestJSON-470499139 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.822a7c60-b39b-4131-9de0-6126c70dea92 is being set with open permissions: ugo+rw Jul 10 04:42:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a376c206-f69d-45e2-9ed8-374c1376fb53 tempest-SnapshotMetadataTestJSON-470499139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.822a7c60-b39b-4131-9de0-6126c70dea92 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:11 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.822a7c60-b39b-4131-9de0-6126c70dea92 Jul 10 04:42:11 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:11 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c7f0663f-8137-4ae9-ac61-ed1ee60e3f6a tempest-VolumeDependencyTests-280830217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33" returned: 0 in 0.981s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c7f0663f-8137-4ae9-ac61-ed1ee60e3f6a tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:11 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33 Jul 10 04:42:11 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:11 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a376c206-f69d-45e2-9ed8-374c1376fb53 tempest-SnapshotMetadataTestJSON-470499139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.822a7c60-b39b-4131-9de0-6126c70dea92" returned: 0 in 0.772s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:11 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=68,cinder:INSERT=13,cinder:UPDATE=82,cinder:DELETE=8 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:42:11 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=97,cinder:DELETE=9,cinder:SELECT=65,cinder:INSERT=28 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:42:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a376c206-f69d-45e2-9ed8-374c1376fb53 tempest-SnapshotMetadataTestJSON-470499139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:12 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.info Jul 10 04:42:12 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:12 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c7f0663f-8137-4ae9-ac61-ed1ee60e3f6a tempest-VolumeDependencyTests-280830217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cd9fefa1-841a-4968-927d-2ae44d559e33" returned: 0 in 1.030s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:12 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c7f0663f-8137-4ae9-ac61-ed1ee60e3f6a tempest-VolumeDependencyTests-280830217 None] Lock "cinder-quobyte-cd9fefa1-841a-4968-927d-2ae44d559e33" released by "delete_volume" :: held 2.121s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:13 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-c7f0663f-8137-4ae9-ac61-ed1ee60e3f6a tempest-VolumeDependencyTests-280830217 None] Created reservations ['de72cf83-f0cc-425e-b1c2-dbac580e2a83', '1ee91e02-b270-4d88-9ce7-f205c1eb4f84', 'a7775857-d6b5-40d4-a0de-f343a22b6a41', 'aa668b26-f4f8-4533-9bee-120e918127fa'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c7f0663f-8137-4ae9-ac61-ed1ee60e3f6a tempest-VolumeDependencyTests-280830217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c7f0663f-8137-4ae9-ac61-ed1ee60e3f6a tempest-VolumeDependencyTests-280830217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:13 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c7f0663f-8137-4ae9-ac61-ed1ee60e3f6a tempest-VolumeDependencyTests-280830217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:13 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c7f0663f-8137-4ae9-ac61-ed1ee60e3f6a tempest-VolumeDependencyTests-280830217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:13 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c7f0663f-8137-4ae9-ac61-ed1ee60e3f6a tempest-VolumeDependencyTests-280830217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c7f0663f-8137-4ae9-ac61-ed1ee60e3f6a tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a376c206-f69d-45e2-9ed8-374c1376fb53 tempest-SnapshotMetadataTestJSON-470499139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.info" returned: 0 in 1.198s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:13 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-a376c206-f69d-45e2-9ed8-374c1376fb53 tempest-SnapshotMetadataTestJSON-470499139 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.info is being set with open permissions: ugo+rw Jul 10 04:42:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a376c206-f69d-45e2-9ed8-374c1376fb53 tempest-SnapshotMetadataTestJSON-470499139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:13 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.info Jul 10 04:42:13 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:13 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:42:13 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:14 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a376c206-f69d-45e2-9ed8-374c1376fb53 tempest-SnapshotMetadataTestJSON-470499139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.info" returned: 0 in 0.953s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:14 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a376c206-f69d-45e2-9ed8-374c1376fb53 tempest-SnapshotMetadataTestJSON-470499139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.898s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c7f0663f-8137-4ae9-ac61-ed1ee60e3f6a tempest-VolumeDependencyTests-280830217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.041s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:14 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-c7f0663f-8137-4ae9-ac61-ed1ee60e3f6a tempest-VolumeDependencyTests-280830217 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6e2037cb-68d7-4b6d-b330-b32829169c25 tempest-VolumeDependencyTests-280830217 None] Acquiring lock "cinder-f928c22a-c962-419a-990a-c2a30c12df09-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:14 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c7f0663f-8137-4ae9-ac61-ed1ee60e3f6a tempest-VolumeDependencyTests-280830217 None] Deleted volume successfully. Jul 10 04:42:14 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a376c206-f69d-45e2-9ed8-374c1376fb53 tempest-SnapshotMetadataTestJSON-470499139 None] Create snapshot completed successfully Jul 10 04:42:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6e2037cb-68d7-4b6d-b330-b32829169c25 tempest-VolumeDependencyTests-280830217 None] Lock "cinder-f928c22a-c962-419a-990a-c2a30c12df09-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c7f0663f-8137-4ae9-ac61-ed1ee60e3f6a tempest-VolumeDependencyTests-280830217 None] Lock "cinder-cd9fefa1-841a-4968-927d-2ae44d559e33-delete_volume" released by "delete_volume" :: held 3.621s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6e2037cb-68d7-4b6d-b330-b32829169c25 tempest-VolumeDependencyTests-280830217 None] Acquiring lock "cinder-quobyte-f928c22a-c962-419a-990a-c2a30c12df09" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6e2037cb-68d7-4b6d-b330-b32829169c25 tempest-VolumeDependencyTests-280830217 None] Lock "cinder-quobyte-f928c22a-c962-419a-990a-c2a30c12df09" acquired by "delete_volume" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:14 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8783a9-1d45-4223-90aa-38622ac3c269]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6e2037cb-68d7-4b6d-b330-b32829169c25 tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f928c22a-c962-419a-990a-c2a30c12df09 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:14 devstack sudo[96082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f928c22a-c962-419a-990a-c2a30c12df09 Jul 10 04:42:14 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:15 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6e2037cb-68d7-4b6d-b330-b32829169c25 tempest-VolumeDependencyTests-280830217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f928c22a-c962-419a-990a-c2a30c12df09" returned: 0 in 0.869s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6e2037cb-68d7-4b6d-b330-b32829169c25 tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f928c22a-c962-419a-990a-c2a30c12df09 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:15 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f928c22a-c962-419a-990a-c2a30c12df09 Jul 10 04:42:15 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-36d8ca38-a5af-46ec-82fc-53a325c12056 tempest-SnapshotMetadataTestJSON-470499139 None] Acquiring lock "cinder-822a7c60-b39b-4131-9de0-6126c70dea92-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-36d8ca38-a5af-46ec-82fc-53a325c12056 tempest-SnapshotMetadataTestJSON-470499139 None] Lock "cinder-822a7c60-b39b-4131-9de0-6126c70dea92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-36d8ca38-a5af-46ec-82fc-53a325c12056 tempest-SnapshotMetadataTestJSON-470499139 None] Acquiring lock "cinder-quobyte-b6b927ad-40ad-459f-89b4-095728806382" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-36d8ca38-a5af-46ec-82fc-53a325c12056 tempest-SnapshotMetadataTestJSON-470499139 None] Lock "cinder-quobyte-b6b927ad-40ad-459f-89b4-095728806382" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-36d8ca38-a5af-46ec-82fc-53a325c12056 tempest-SnapshotMetadataTestJSON-470499139 None] Acquiring lock "cinder-quobyte-822a7c60-b39b-4131-9de0-6126c70dea92" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-36d8ca38-a5af-46ec-82fc-53a325c12056 tempest-SnapshotMetadataTestJSON-470499139 None] Lock "cinder-quobyte-822a7c60-b39b-4131-9de0-6126c70dea92" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-36d8ca38-a5af-46ec-82fc-53a325c12056 tempest-SnapshotMetadataTestJSON-470499139 None] Deleting offline snapshot 822a7c60-b39b-4131-9de0-6126c70dea92 of volume b6b927ad-40ad-459f-89b4-095728806382 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:42:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-36d8ca38-a5af-46ec-82fc-53a325c12056 tempest-SnapshotMetadataTestJSON-470499139 None] snapshot_file for this snap is: volume-b6b927ad-40ad-459f-89b4-095728806382.822a7c60-b39b-4131-9de0-6126c70dea92 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:42:15 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[92add0ce-4957-4d1d-93db-5303a2ef5cf5]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-36d8ca38-a5af-46ec-82fc-53a325c12056 tempest-SnapshotMetadataTestJSON-470499139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.822a7c60-b39b-4131-9de0-6126c70dea92 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:15 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.822a7c60-b39b-4131-9de0-6126c70dea92 Jul 10 04:42:15 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:42:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:15 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:42:15 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:16 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6e2037cb-68d7-4b6d-b330-b32829169c25 tempest-VolumeDependencyTests-280830217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f928c22a-c962-419a-990a-c2a30c12df09" returned: 0 in 0.842s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:16 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6e2037cb-68d7-4b6d-b330-b32829169c25 tempest-VolumeDependencyTests-280830217 None] Lock "cinder-quobyte-f928c22a-c962-419a-990a-c2a30c12df09" released by "delete_volume" :: held 1.755s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:16 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-6e2037cb-68d7-4b6d-b330-b32829169c25 tempest-VolumeDependencyTests-280830217 None] Created reservations ['9456587f-4743-4854-9198-a9d6563a5f70', 'ea1a2ded-ff29-4ed9-9448-ef974cf7c1e6', '8a9acc49-3ac8-4131-8999-afa2479357bb', '64911e44-c940-473d-8518-fb896cbb4bab'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6e2037cb-68d7-4b6d-b330-b32829169c25 tempest-VolumeDependencyTests-280830217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6e2037cb-68d7-4b6d-b330-b32829169c25 tempest-VolumeDependencyTests-280830217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:16 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6e2037cb-68d7-4b6d-b330-b32829169c25 tempest-VolumeDependencyTests-280830217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:16 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6e2037cb-68d7-4b6d-b330-b32829169c25 tempest-VolumeDependencyTests-280830217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6e2037cb-68d7-4b6d-b330-b32829169c25 tempest-VolumeDependencyTests-280830217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6e2037cb-68d7-4b6d-b330-b32829169c25 tempest-VolumeDependencyTests-280830217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:16 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:42:16 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:16 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-36d8ca38-a5af-46ec-82fc-53a325c12056 tempest-SnapshotMetadataTestJSON-470499139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.822a7c60-b39b-4131-9de0-6126c70dea92" returned: 0 in 0.886s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:16 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-36d8ca38-a5af-46ec-82fc-53a325c12056 tempest-SnapshotMetadataTestJSON-470499139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6b927ad-40ad-459f-89b4-095728806382(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:42:16 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[29294b56-591b-42c7-9d68-5e66f775b1e8]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-36d8ca38-a5af-46ec-82fc-53a325c12056 tempest-SnapshotMetadataTestJSON-470499139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:16 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.871s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:42:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:42:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:42:16 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382 Jul 10 04:42:16 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:17 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6e2037cb-68d7-4b6d-b330-b32829169c25 tempest-VolumeDependencyTests-280830217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.892s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:17 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-6e2037cb-68d7-4b6d-b330-b32829169c25 tempest-VolumeDependencyTests-280830217 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:17 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-6e2037cb-68d7-4b6d-b330-b32829169c25 tempest-VolumeDependencyTests-280830217 None] Deleted volume successfully. Jul 10 04:42:17 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6e2037cb-68d7-4b6d-b330-b32829169c25 tempest-VolumeDependencyTests-280830217 None] Lock "cinder-f928c22a-c962-419a-990a-c2a30c12df09-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:17 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-36d8ca38-a5af-46ec-82fc-53a325c12056 tempest-SnapshotMetadataTestJSON-470499139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382" returned: 0 in 1.079s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-36d8ca38-a5af-46ec-82fc-53a325c12056 tempest-SnapshotMetadataTestJSON-470499139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.822a7c60-b39b-4131-9de0-6126c70dea92 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:17 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.822a7c60-b39b-4131-9de0-6126c70dea92 Jul 10 04:42:17 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:18 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-36d8ca38-a5af-46ec-82fc-53a325c12056 tempest-SnapshotMetadataTestJSON-470499139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.822a7c60-b39b-4131-9de0-6126c70dea92" returned: 0 in 1.008s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-36d8ca38-a5af-46ec-82fc-53a325c12056 tempest-SnapshotMetadataTestJSON-470499139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.822a7c60-b39b-4131-9de0-6126c70dea92 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:18 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.822a7c60-b39b-4131-9de0-6126c70dea92 Jul 10 04:42:18 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ef5bee4b-643d-4adb-a468-bf73116b2c59 tempest-AttachVolumeShelveTestJSON-193693134 None] Acquiring lock "cinder-9342fd34-254c-42f0-bf55-c0139f191096-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ef5bee4b-643d-4adb-a468-bf73116b2c59 tempest-AttachVolumeShelveTestJSON-193693134 None] Lock "cinder-9342fd34-254c-42f0-bf55-c0139f191096-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ef5bee4b-643d-4adb-a468-bf73116b2c59 tempest-AttachVolumeShelveTestJSON-193693134 None] Acquiring lock "cinder-quobyte-9342fd34-254c-42f0-bf55-c0139f191096" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ef5bee4b-643d-4adb-a468-bf73116b2c59 tempest-AttachVolumeShelveTestJSON-193693134 None] Lock "cinder-quobyte-9342fd34-254c-42f0-bf55-c0139f191096" acquired by "delete_volume" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:19 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e7a56f-a3ff-4520-8de8-218e2d194dcc]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ef5bee4b-643d-4adb-a468-bf73116b2c59 tempest-AttachVolumeShelveTestJSON-193693134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9342fd34-254c-42f0-bf55-c0139f191096 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:19 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9342fd34-254c-42f0-bf55-c0139f191096 Jul 10 04:42:19 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:19 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-36d8ca38-a5af-46ec-82fc-53a325c12056 tempest-SnapshotMetadataTestJSON-470499139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382.822a7c60-b39b-4131-9de0-6126c70dea92" returned: 0 in 0.897s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-36d8ca38-a5af-46ec-82fc-53a325c12056 tempest-SnapshotMetadataTestJSON-470499139 None] Lock "cinder-quobyte-822a7c60-b39b-4131-9de0-6126c70dea92" released by "_delete_snapshot" :: held 4.072s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-36d8ca38-a5af-46ec-82fc-53a325c12056 tempest-SnapshotMetadataTestJSON-470499139 None] Lock "cinder-quobyte-b6b927ad-40ad-459f-89b4-095728806382" released by "delete_snapshot" :: held 4.102s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:19 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-36d8ca38-a5af-46ec-82fc-53a325c12056 tempest-SnapshotMetadataTestJSON-470499139 None] Created reservations ['8b066c0a-66f2-455b-87ae-6aa8bb4bcaf1', '7559fa78-4634-431d-81a1-c75838942590', 'c367fda5-5ca6-44a7-8f6e-15edba8fa66f', '097cb5df-609d-4020-a32c-2244d095683a'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:19 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-36d8ca38-a5af-46ec-82fc-53a325c12056 tempest-SnapshotMetadataTestJSON-470499139 None] Delete snapshot completed successfully. Jul 10 04:42:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-36d8ca38-a5af-46ec-82fc-53a325c12056 tempest-SnapshotMetadataTestJSON-470499139 None] Lock "cinder-822a7c60-b39b-4131-9de0-6126c70dea92-delete_snapshot" released by "delete_snapshot" :: held 4.308s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:20 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ef5bee4b-643d-4adb-a468-bf73116b2c59 tempest-AttachVolumeShelveTestJSON-193693134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9342fd34-254c-42f0-bf55-c0139f191096" returned: 0 in 0.938s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ef5bee4b-643d-4adb-a468-bf73116b2c59 tempest-AttachVolumeShelveTestJSON-193693134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9342fd34-254c-42f0-bf55-c0139f191096 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:20 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9342fd34-254c-42f0-bf55-c0139f191096 Jul 10 04:42:20 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:20 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:20 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3f7125dd-345e-4f74-9c4d-59068878ce02 tempest-SnapshotMetadataTestJSON-470499139 None] Acquiring lock "cinder-b6b927ad-40ad-459f-89b4-095728806382-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ef5bee4b-643d-4adb-a468-bf73116b2c59 tempest-AttachVolumeShelveTestJSON-193693134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9342fd34-254c-42f0-bf55-c0139f191096" returned: 0 in 0.751s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:21 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ef5bee4b-643d-4adb-a468-bf73116b2c59 tempest-AttachVolumeShelveTestJSON-193693134 None] Lock "cinder-quobyte-9342fd34-254c-42f0-bf55-c0139f191096" released by "delete_volume" :: held 1.757s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:21 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3f7125dd-345e-4f74-9c4d-59068878ce02 tempest-SnapshotMetadataTestJSON-470499139 None] Lock "cinder-b6b927ad-40ad-459f-89b4-095728806382-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:21 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3f7125dd-345e-4f74-9c4d-59068878ce02 tempest-SnapshotMetadataTestJSON-470499139 None] Acquiring lock "cinder-quobyte-b6b927ad-40ad-459f-89b4-095728806382" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:21 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3f7125dd-345e-4f74-9c4d-59068878ce02 tempest-SnapshotMetadataTestJSON-470499139 None] Lock "cinder-quobyte-b6b927ad-40ad-459f-89b4-095728806382" acquired by "delete_volume" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:21 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-ef5bee4b-643d-4adb-a468-bf73116b2c59 tempest-AttachVolumeShelveTestJSON-193693134 None] Created reservations ['a7f3f527-cc5f-4d05-a701-e874a5b4b5e4', '1e251eaf-81e1-4c08-93f3-a07932fc4154', '79990df9-c59d-4f64-b2e9-ab714f8b19ab', 'e4fbb24d-0a9a-4db5-835e-f371e5dc9ca3'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:21 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[75604761-64c4-401d-b4cd-4ad851fa7bae]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3f7125dd-345e-4f74-9c4d-59068878ce02 tempest-SnapshotMetadataTestJSON-470499139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ef5bee4b-643d-4adb-a468-bf73116b2c59 tempest-AttachVolumeShelveTestJSON-193693134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ef5bee4b-643d-4adb-a468-bf73116b2c59 tempest-AttachVolumeShelveTestJSON-193693134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ef5bee4b-643d-4adb-a468-bf73116b2c59 tempest-AttachVolumeShelveTestJSON-193693134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ef5bee4b-643d-4adb-a468-bf73116b2c59 tempest-AttachVolumeShelveTestJSON-193693134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ef5bee4b-643d-4adb-a468-bf73116b2c59 tempest-AttachVolumeShelveTestJSON-193693134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ef5bee4b-643d-4adb-a468-bf73116b2c59 tempest-AttachVolumeShelveTestJSON-193693134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:21 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:42:21 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:21 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382 Jul 10 04:42:21 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:22 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ef5bee4b-643d-4adb-a468-bf73116b2c59 tempest-AttachVolumeShelveTestJSON-193693134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.817s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:22 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-ef5bee4b-643d-4adb-a468-bf73116b2c59 tempest-AttachVolumeShelveTestJSON-193693134 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:22 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ef5bee4b-643d-4adb-a468-bf73116b2c59 tempest-AttachVolumeShelveTestJSON-193693134 None] Deleted volume successfully. Jul 10 04:42:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ef5bee4b-643d-4adb-a468-bf73116b2c59 tempest-AttachVolumeShelveTestJSON-193693134 None] Lock "cinder-9342fd34-254c-42f0-bf55-c0139f191096-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:22 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3f7125dd-345e-4f74-9c4d-59068878ce02 tempest-SnapshotMetadataTestJSON-470499139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382" returned: 0 in 1.338s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3f7125dd-345e-4f74-9c4d-59068878ce02 tempest-SnapshotMetadataTestJSON-470499139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:22 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382 Jul 10 04:42:22 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:23 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3f7125dd-345e-4f74-9c4d-59068878ce02 tempest-SnapshotMetadataTestJSON-470499139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b6b927ad-40ad-459f-89b4-095728806382" returned: 0 in 0.940s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:23 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3f7125dd-345e-4f74-9c4d-59068878ce02 tempest-SnapshotMetadataTestJSON-470499139 None] Lock "cinder-quobyte-b6b927ad-40ad-459f-89b4-095728806382" released by "delete_volume" :: held 2.366s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:23 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-3f7125dd-345e-4f74-9c4d-59068878ce02 tempest-SnapshotMetadataTestJSON-470499139 None] Created reservations ['a62601ed-f2ee-47ce-a286-79c9e139f3ca', '1b82dbbc-f2fb-415f-94c2-5fec650effdf', '345bfa23-6281-4182-a4a6-724d9fd4f0a1', '0fa49995-69f0-4f9f-a9a3-94a32f3e35f1'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3f7125dd-345e-4f74-9c4d-59068878ce02 tempest-SnapshotMetadataTestJSON-470499139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3f7125dd-345e-4f74-9c4d-59068878ce02 tempest-SnapshotMetadataTestJSON-470499139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:23 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3f7125dd-345e-4f74-9c4d-59068878ce02 tempest-SnapshotMetadataTestJSON-470499139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:23 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3f7125dd-345e-4f74-9c4d-59068878ce02 tempest-SnapshotMetadataTestJSON-470499139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3f7125dd-345e-4f74-9c4d-59068878ce02 tempest-SnapshotMetadataTestJSON-470499139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3f7125dd-345e-4f74-9c4d-59068878ce02 tempest-SnapshotMetadataTestJSON-470499139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:23 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:42:23 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:24 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3f7125dd-345e-4f74-9c4d-59068878ce02 tempest-SnapshotMetadataTestJSON-470499139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.658s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:24 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-3f7125dd-345e-4f74-9c4d-59068878ce02 tempest-SnapshotMetadataTestJSON-470499139 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:24 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-3f7125dd-345e-4f74-9c4d-59068878ce02 tempest-SnapshotMetadataTestJSON-470499139 None] Deleted volume successfully. Jul 10 04:42:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3f7125dd-345e-4f74-9c4d-59068878ce02 tempest-SnapshotMetadataTestJSON-470499139 None] Lock "cinder-b6b927ad-40ad-459f-89b4-095728806382-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:28 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:42:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Flow 'volume_create_manager' (61583c9f-3d88-4fdb-8a3e-f260ab2a1953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5b4926-8850-4f15-9b82-f987fc46ed91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5b4926-8850-4f15-9b82-f987fc46ed91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2078622629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d493bb242aae41b3a451777065f04c48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:28Z,use_quota=True,user_id='2a283cab8b634059a42cab5fb4777000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e9d40c3-db44-4a02-84dc-44c8dcad2e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e9d40c3-db44-4a02-84dc-44c8dcad2e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b54fcc-931b-4f70-87f0-1e9da70f5a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b54fcc-931b-4f70-87f0-1e9da70f5a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba', 'volume_name': 'volume-0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31603cf-da2a-4aa0-9174-4654d3ce3278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31603cf-da2a-4aa0-9174-4654d3ce3278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b9d9e2-c486-474d-888f-2ffe5ac85de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:28 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Volume 0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba', 'volume_size': 1} Jul 10 04:42:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2078622629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d493bb242aae41b3a451777065f04c48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:28Z,use_quota=True,user_id='2a283cab8b634059a42cab5fb4777000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:42:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Creating volume 0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:42:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:42:28 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:42:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:28 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba 1073741824 Jul 10 04:42:28 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:29 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba 1073741824" returned: 0 in 1.305s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:29 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:42:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Flow 'volume_create_manager' (853128fc-8129-42f3-a497-c0829a3658ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf0e347-fbb6-4087-8a6d-9dfa022733f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf0e347-fbb6-4087-8a6d-9dfa022733f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-634206347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2ae4b2a237e49308eb2641c6dd07b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:30Z,use_quota=True,user_id='0bb2c1453722427eab9270ae94b8aeb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b87d76d2-7d12-4e04-bd6d-51de1b92a453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b87d76d2-7d12-4e04-bd6d-51de1b92a453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (754cf28e-78c9-43c3-8522-5ac7c8899bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (754cf28e-78c9-43c3-8522-5ac7c8899bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9', 'volume_name': 'volume-047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ec9974-9464-4e02-9fe6-838a031d7136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ec9974-9464-4e02-9fe6-838a031d7136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a692f58-7fb9-4785-b2c5-bf41d9ef468c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:29 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Volume 047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9', 'volume_size': 1} Jul 10 04:42:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:29 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba Jul 10 04:42:29 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:30 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba" returned: 0 in 0.816s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:30 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] <== create_volume: return (2290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:42:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.294s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.831s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:30 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-634206347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2ae4b2a237e49308eb2641c6dd07b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:30Z,use_quota=True,user_id='0bb2c1453722427eab9270ae94b8aeb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:42:30 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Creating volume 047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:42:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:30 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:30 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:30 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:42:30 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:42:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:30 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9 1073741824 Jul 10 04:42:30 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:30 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b9d9e2-c486-474d-888f-2ffe5ac85de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:30 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983c1ba5-8330-4c3b-aa1d-8b59ae3ee1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:30 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Volume volume-0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba (0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba): created successfully Jul 10 04:42:30 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983c1ba5-8330-4c3b-aa1d-8b59ae3ee1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:30 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Flow 'volume_create_manager' (61583c9f-3d88-4fdb-8a3e-f260ab2a1953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:30 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-5194bc96-3a56-4dac-ba0f-261f49bccd1e tempest-ProjectReaderTests-705535892 None] Created volume successfully. Jul 10 04:42:31 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9 1073741824" returned: 0 in 1.106s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:31 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9 Jul 10 04:42:31 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:31 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-db832d30-600f-4e85-8240-e0f588e8329f tempest-ProjectReaderTests-705535892 None] Acquiring lock "cinder-0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-db832d30-600f-4e85-8240-e0f588e8329f tempest-ProjectReaderTests-705535892 None] Lock "cinder-0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-db832d30-600f-4e85-8240-e0f588e8329f tempest-ProjectReaderTests-705535892 None] Acquiring lock "cinder-quobyte-0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-db832d30-600f-4e85-8240-e0f588e8329f tempest-ProjectReaderTests-705535892 None] Lock "cinder-quobyte-0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba" acquired by "delete_volume" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:32 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dad2f31-ac6f-4489-a642-65907192a68c]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-db832d30-600f-4e85-8240-e0f588e8329f tempest-ProjectReaderTests-705535892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:32 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba Jul 10 04:42:32 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:32 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9" returned: 0 in 0.885s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:42:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a692f58-7fb9-4785-b2c5-bf41d9ef468c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06532a15-b35b-420a-9b24-52dc4cb7979d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:32 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Volume volume-047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9 (047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9): created successfully Jul 10 04:42:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06532a15-b35b-420a-9b24-52dc4cb7979d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Flow 'volume_create_manager' (853128fc-8129-42f3-a497-c0829a3658ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:32 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-6f7d31fa-aeec-4c9b-bbed-cf8eec4c8c5b tempest-VolumesMetadataTest-1494267046 None] Created volume successfully. Jul 10 04:42:33 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-db832d30-600f-4e85-8240-e0f588e8329f tempest-ProjectReaderTests-705535892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba" returned: 0 in 0.957s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-db832d30-600f-4e85-8240-e0f588e8329f tempest-ProjectReaderTests-705535892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:33 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba Jul 10 04:42:33 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:33 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-db832d30-600f-4e85-8240-e0f588e8329f tempest-ProjectReaderTests-705535892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba" returned: 0 in 0.745s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-db832d30-600f-4e85-8240-e0f588e8329f tempest-ProjectReaderTests-705535892 None] Lock "cinder-quobyte-0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba" released by "delete_volume" :: held 1.762s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:33 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-db832d30-600f-4e85-8240-e0f588e8329f tempest-ProjectReaderTests-705535892 None] Created reservations ['d135a108-4a3c-46a3-8882-9ecd45e45e73', '6b0ee4e7-717f-4345-aba2-37065627e827', '73226530-3db2-4253-929e-a49460d748ea', 'b7fa71a7-b697-47e8-a225-c18f2c100e6c'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-db832d30-600f-4e85-8240-e0f588e8329f tempest-ProjectReaderTests-705535892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-db832d30-600f-4e85-8240-e0f588e8329f tempest-ProjectReaderTests-705535892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-db832d30-600f-4e85-8240-e0f588e8329f tempest-ProjectReaderTests-705535892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-db832d30-600f-4e85-8240-e0f588e8329f tempest-ProjectReaderTests-705535892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-db832d30-600f-4e85-8240-e0f588e8329f tempest-ProjectReaderTests-705535892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-db832d30-600f-4e85-8240-e0f588e8329f tempest-ProjectReaderTests-705535892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:34 devstack sudo[96171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:42:34 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:35 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-db832d30-600f-4e85-8240-e0f588e8329f tempest-ProjectReaderTests-705535892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.943s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-db832d30-600f-4e85-8240-e0f588e8329f tempest-ProjectReaderTests-705535892 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:35 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-db832d30-600f-4e85-8240-e0f588e8329f tempest-ProjectReaderTests-705535892 None] Deleted volume successfully. Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-db832d30-600f-4e85-8240-e0f588e8329f tempest-ProjectReaderTests-705535892 None] Lock "cinder-0ea6abda-fa0c-497e-b6b0-b9bcb4fde9ba-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Flow 'volume_create_manager' (39d0135a-4def-42cd-8c23-f1a488e8e7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeba09e1-d198-428b-b257-748cc219862d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ce7ee51f-eb93-4f1e-9688-0588ed33c8cb tempest-VolumesMetadataTest-1494267046 None] Acquiring lock "cinder-047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeba09e1-d198-428b-b257-748cc219862d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-604732728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9156280b-c25a-4ec7-aa69-4faca7f853ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d493bb242aae41b3a451777065f04c48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:35Z,use_quota=True,user_id='2a283cab8b634059a42cab5fb4777000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a79d8f5-453a-4565-97a8-b85e1be13737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a79d8f5-453a-4565-97a8-b85e1be13737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af34609-d30b-431b-af38-ae6c86361678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af34609-d30b-431b-af38-ae6c86361678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9156280b-c25a-4ec7-aa69-4faca7f853ed', 'volume_name': 'volume-9156280b-c25a-4ec7-aa69-4faca7f853ed', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff2e8cf-7704-4c31-9303-66de5de04fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff2e8cf-7704-4c31-9303-66de5de04fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a42077-18c7-4432-87dd-443a8f6800bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:35 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Volume 9156280b-c25a-4ec7-aa69-4faca7f853ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9156280b-c25a-4ec7-aa69-4faca7f853ed', 'volume_size': 1} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-604732728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9156280b-c25a-4ec7-aa69-4faca7f853ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d493bb242aae41b3a451777065f04c48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:35Z,use_quota=True,user_id='2a283cab8b634059a42cab5fb4777000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Creating volume 9156280b-c25a-4ec7-aa69-4faca7f853ed {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:42:35 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9156280b-c25a-4ec7-aa69-4faca7f853ed 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ce7ee51f-eb93-4f1e-9688-0588ed33c8cb tempest-VolumesMetadataTest-1494267046 None] Lock "cinder-047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9-delete_volume" acquired by "delete_volume" :: waited 0.125s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:35 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9156280b-c25a-4ec7-aa69-4faca7f853ed 1073741824 Jul 10 04:42:35 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ce7ee51f-eb93-4f1e-9688-0588ed33c8cb tempest-VolumesMetadataTest-1494267046 None] Acquiring lock "cinder-quobyte-047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ce7ee51f-eb93-4f1e-9688-0588ed33c8cb tempest-VolumesMetadataTest-1494267046 None] Lock "cinder-quobyte-047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9" acquired by "delete_volume" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbeb7fe-e6ad-4a8b-86e6-80ef071d6b08]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ce7ee51f-eb93-4f1e-9688-0588ed33c8cb tempest-VolumesMetadataTest-1494267046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:35 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9 Jul 10 04:42:35 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:36 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ce7ee51f-eb93-4f1e-9688-0588ed33c8cb tempest-VolumesMetadataTest-1494267046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9" returned: 0 in 1.070s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ce7ee51f-eb93-4f1e-9688-0588ed33c8cb tempest-VolumesMetadataTest-1494267046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:36 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9 Jul 10 04:42:36 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:36 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9156280b-c25a-4ec7-aa69-4faca7f853ed 1073741824" returned: 0 in 1.308s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9156280b-c25a-4ec7-aa69-4faca7f853ed {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:36 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9156280b-c25a-4ec7-aa69-4faca7f853ed Jul 10 04:42:36 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:37 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ce7ee51f-eb93-4f1e-9688-0588ed33c8cb tempest-VolumesMetadataTest-1494267046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9" returned: 0 in 0.754s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ce7ee51f-eb93-4f1e-9688-0588ed33c8cb tempest-VolumesMetadataTest-1494267046 None] Lock "cinder-quobyte-047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9" released by "delete_volume" :: held 1.887s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:37 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-ce7ee51f-eb93-4f1e-9688-0588ed33c8cb tempest-VolumesMetadataTest-1494267046 None] Created reservations ['3a679f5c-7aa5-44f2-ba97-e9620de7ac2e', '493bad16-0446-43c1-92c8-57237063c998', '444cc35f-3b0e-4bea-9053-3bcb5c1169df', '20210eda-3b57-451e-a923-4ff1fe013759'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ce7ee51f-eb93-4f1e-9688-0588ed33c8cb tempest-VolumesMetadataTest-1494267046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ce7ee51f-eb93-4f1e-9688-0588ed33c8cb tempest-VolumesMetadataTest-1494267046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ce7ee51f-eb93-4f1e-9688-0588ed33c8cb tempest-VolumesMetadataTest-1494267046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ce7ee51f-eb93-4f1e-9688-0588ed33c8cb tempest-VolumesMetadataTest-1494267046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ce7ee51f-eb93-4f1e-9688-0588ed33c8cb tempest-VolumesMetadataTest-1494267046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ce7ee51f-eb93-4f1e-9688-0588ed33c8cb tempest-VolumesMetadataTest-1494267046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:37 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:42:37 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:37 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9156280b-c25a-4ec7-aa69-4faca7f853ed" returned: 0 in 0.937s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] <== create_volume: return (2315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:42:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.321s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a42077-18c7-4432-87dd-443a8f6800bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9156280b-c25a-4ec7-aa69-4faca7f853ed', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36bac14-f64c-4a7f-8142-23bc13670c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:37 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Volume volume-9156280b-c25a-4ec7-aa69-4faca7f853ed (9156280b-c25a-4ec7-aa69-4faca7f853ed): created successfully Jul 10 04:42:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36bac14-f64c-4a7f-8142-23bc13670c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Flow 'volume_create_manager' (39d0135a-4def-42cd-8c23-f1a488e8e7d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:37 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-1662a53e-0128-46a2-8460-d1079bef209d tempest-ProjectReaderTests-705535892 None] Created volume successfully. Jul 10 04:42:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0b14f86f-f3c0-4199-963e-d38fd80a340c tempest-ProjectReaderTests-705535892 None] Acquiring lock "cinder-9156280b-c25a-4ec7-aa69-4faca7f853ed-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0b14f86f-f3c0-4199-963e-d38fd80a340c tempest-ProjectReaderTests-705535892 None] Lock "cinder-9156280b-c25a-4ec7-aa69-4faca7f853ed-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:38 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ce7ee51f-eb93-4f1e-9688-0588ed33c8cb tempest-VolumesMetadataTest-1494267046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.003s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:38 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-ce7ee51f-eb93-4f1e-9688-0588ed33c8cb tempest-VolumesMetadataTest-1494267046 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:38 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ce7ee51f-eb93-4f1e-9688-0588ed33c8cb tempest-VolumesMetadataTest-1494267046 None] Deleted volume successfully. Jul 10 04:42:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0b14f86f-f3c0-4199-963e-d38fd80a340c tempest-ProjectReaderTests-705535892 None] Acquiring lock "cinder-quobyte-9156280b-c25a-4ec7-aa69-4faca7f853ed" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0b14f86f-f3c0-4199-963e-d38fd80a340c tempest-ProjectReaderTests-705535892 None] Lock "cinder-quobyte-9156280b-c25a-4ec7-aa69-4faca7f853ed" acquired by "delete_volume" :: waited 0.027s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ce7ee51f-eb93-4f1e-9688-0588ed33c8cb tempest-VolumesMetadataTest-1494267046 None] Lock "cinder-047ff2a4-515f-4bc3-ab4c-fe3f0a9007f9-delete_volume" released by "delete_volume" :: held 3.220s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:38 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad831cd-8a0d-480a-8e94-37c3f92c5afa]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0b14f86f-f3c0-4199-963e-d38fd80a340c tempest-ProjectReaderTests-705535892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9156280b-c25a-4ec7-aa69-4faca7f853ed {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:38 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9156280b-c25a-4ec7-aa69-4faca7f853ed Jul 10 04:42:38 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:39 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0b14f86f-f3c0-4199-963e-d38fd80a340c tempest-ProjectReaderTests-705535892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9156280b-c25a-4ec7-aa69-4faca7f853ed" returned: 0 in 0.812s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0b14f86f-f3c0-4199-963e-d38fd80a340c tempest-ProjectReaderTests-705535892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9156280b-c25a-4ec7-aa69-4faca7f853ed {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:39 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9156280b-c25a-4ec7-aa69-4faca7f853ed Jul 10 04:42:39 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:40 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0b14f86f-f3c0-4199-963e-d38fd80a340c tempest-ProjectReaderTests-705535892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9156280b-c25a-4ec7-aa69-4faca7f853ed" returned: 0 in 0.716s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:40 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0b14f86f-f3c0-4199-963e-d38fd80a340c tempest-ProjectReaderTests-705535892 None] Lock "cinder-quobyte-9156280b-c25a-4ec7-aa69-4faca7f853ed" released by "delete_volume" :: held 1.582s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:40 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-0b14f86f-f3c0-4199-963e-d38fd80a340c tempest-ProjectReaderTests-705535892 None] Created reservations ['d7ad4747-d40a-473e-96c8-122bfb1e47f7', '616a9ad9-1e90-49bd-a61d-0f63ac983ca6', 'afd5fc79-64e7-4e6f-9ddb-116fc89a71d3', '703f3675-02f7-43eb-888a-0ed976189b55'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0b14f86f-f3c0-4199-963e-d38fd80a340c tempest-ProjectReaderTests-705535892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0b14f86f-f3c0-4199-963e-d38fd80a340c tempest-ProjectReaderTests-705535892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-0b14f86f-f3c0-4199-963e-d38fd80a340c tempest-ProjectReaderTests-705535892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-0b14f86f-f3c0-4199-963e-d38fd80a340c tempest-ProjectReaderTests-705535892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0b14f86f-f3c0-4199-963e-d38fd80a340c tempest-ProjectReaderTests-705535892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0b14f86f-f3c0-4199-963e-d38fd80a340c tempest-ProjectReaderTests-705535892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:40 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:42:40 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:41 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0b14f86f-f3c0-4199-963e-d38fd80a340c tempest-ProjectReaderTests-705535892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.922s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-0b14f86f-f3c0-4199-963e-d38fd80a340c tempest-ProjectReaderTests-705535892 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:41 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-0b14f86f-f3c0-4199-963e-d38fd80a340c tempest-ProjectReaderTests-705535892 None] Deleted volume successfully. Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0b14f86f-f3c0-4199-963e-d38fd80a340c tempest-ProjectReaderTests-705535892 None] Lock "cinder-9156280b-c25a-4ec7-aa69-4faca7f853ed-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Flow 'volume_create_manager' (b303fd93-5d0b-4fcc-83ce-7d9c4c529a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54428307-c576-4d08-8eb2-0008feee7e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54428307-c576-4d08-8eb2-0008feee7e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1504659459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865c9bd9-5ac4-44c5-a11f-d0026724d635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d493bb242aae41b3a451777065f04c48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:41Z,use_quota=True,user_id='2a283cab8b634059a42cab5fb4777000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377c3555-6809-4f98-834f-93d3ca2d364a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377c3555-6809-4f98-834f-93d3ca2d364a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ad078e-b7ef-4791-b50b-7d4e9583759b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ad078e-b7ef-4791-b50b-7d4e9583759b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '865c9bd9-5ac4-44c5-a11f-d0026724d635', 'volume_name': 'volume-865c9bd9-5ac4-44c5-a11f-d0026724d635', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6744c160-99bc-457e-8551-83a38d8e3002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6744c160-99bc-457e-8551-83a38d8e3002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6729c287-c2c4-442b-bcd8-859663999cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:41 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Volume 865c9bd9-5ac4-44c5-a11f-d0026724d635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-865c9bd9-5ac4-44c5-a11f-d0026724d635', 'volume_size': 1} Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1504659459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865c9bd9-5ac4-44c5-a11f-d0026724d635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d493bb242aae41b3a451777065f04c48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:41Z,use_quota=True,user_id='2a283cab8b634059a42cab5fb4777000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Creating volume 865c9bd9-5ac4-44c5-a11f-d0026724d635 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:42:41 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:42:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-865c9bd9-5ac4-44c5-a11f-d0026724d635 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:41 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-865c9bd9-5ac4-44c5-a11f-d0026724d635 1073741824 Jul 10 04:42:41 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:42 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-865c9bd9-5ac4-44c5-a11f-d0026724d635 1073741824" returned: 0 in 1.096s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-865c9bd9-5ac4-44c5-a11f-d0026724d635 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:42 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-865c9bd9-5ac4-44c5-a11f-d0026724d635 Jul 10 04:42:42 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:43 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-865c9bd9-5ac4-44c5-a11f-d0026724d635" returned: 0 in 0.911s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:43 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:42:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6729c287-c2c4-442b-bcd8-859663999cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-865c9bd9-5ac4-44c5-a11f-d0026724d635', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6468fbc-c1c9-4f77-bf23-d3f728afefdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:43 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Volume volume-865c9bd9-5ac4-44c5-a11f-d0026724d635 (865c9bd9-5ac4-44c5-a11f-d0026724d635): created successfully Jul 10 04:42:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6468fbc-c1c9-4f77-bf23-d3f728afefdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Flow 'volume_create_manager' (b303fd93-5d0b-4fcc-83ce-7d9c4c529a2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:43 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-f786501d-c581-41b2-a561-454f02092dae tempest-ProjectReaderTests-705535892 None] Created volume successfully. Jul 10 04:42:44 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-245b0a92-77c9-455b-9392-5894dd896e76 tempest-ProjectReaderTests-705535892 None] Acquiring lock "cinder-865c9bd9-5ac4-44c5-a11f-d0026724d635-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:44 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-245b0a92-77c9-455b-9392-5894dd896e76 tempest-ProjectReaderTests-705535892 None] Lock "cinder-865c9bd9-5ac4-44c5-a11f-d0026724d635-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:44 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-245b0a92-77c9-455b-9392-5894dd896e76 tempest-ProjectReaderTests-705535892 None] Acquiring lock "cinder-quobyte-865c9bd9-5ac4-44c5-a11f-d0026724d635" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:44 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-245b0a92-77c9-455b-9392-5894dd896e76 tempest-ProjectReaderTests-705535892 None] Lock "cinder-quobyte-865c9bd9-5ac4-44c5-a11f-d0026724d635" acquired by "delete_volume" :: waited 0.030s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:44 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e024f91-fcce-4c86-b897-334191b52e52]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-245b0a92-77c9-455b-9392-5894dd896e76 tempest-ProjectReaderTests-705535892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-865c9bd9-5ac4-44c5-a11f-d0026724d635 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:45 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-865c9bd9-5ac4-44c5-a11f-d0026724d635 Jul 10 04:42:45 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:46 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-245b0a92-77c9-455b-9392-5894dd896e76 tempest-ProjectReaderTests-705535892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-865c9bd9-5ac4-44c5-a11f-d0026724d635" returned: 0 in 1.114s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-245b0a92-77c9-455b-9392-5894dd896e76 tempest-ProjectReaderTests-705535892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-865c9bd9-5ac4-44c5-a11f-d0026724d635 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:46 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-865c9bd9-5ac4-44c5-a11f-d0026724d635 Jul 10 04:42:46 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:46 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-245b0a92-77c9-455b-9392-5894dd896e76 tempest-ProjectReaderTests-705535892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-865c9bd9-5ac4-44c5-a11f-d0026724d635" returned: 0 in 0.808s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:46 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-245b0a92-77c9-455b-9392-5894dd896e76 tempest-ProjectReaderTests-705535892 None] Lock "cinder-quobyte-865c9bd9-5ac4-44c5-a11f-d0026724d635" released by "delete_volume" :: held 1.985s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-245b0a92-77c9-455b-9392-5894dd896e76 tempest-ProjectReaderTests-705535892 None] Created reservations ['681b0ac7-68ba-475c-aa7f-f7568a564377', '37d552a5-79f2-497c-82c3-aae60cca648c', '6683e088-3dc0-4e0e-8420-9b288ecbc822', '4c7508cb-1d0e-433e-9034-6ea7ebd6ff21'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Flow 'volume_create_manager' (f07c2d0c-b7a4-4c82-91f4-4544ded52d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc8dbea-7244-4505-9b9a-6051a590b83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc8dbea-7244-4505-9b9a-6051a590b83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1334630244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93957d66-43a8-40d0-8344-ab6c2b0a21c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e794868cd5194548a581033d1675d490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:47Z,use_quota=True,user_id='e4dc843304fb4087b731ecf86e4e7d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcadde50-cd76-447a-b344-e530fe7276cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcadde50-cd76-447a-b344-e530fe7276cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af3d098-db86-45be-ba7f-15d8b99f341c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af3d098-db86-45be-ba7f-15d8b99f341c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93957d66-43a8-40d0-8344-ab6c2b0a21c2', 'volume_name': 'volume-93957d66-43a8-40d0-8344-ab6c2b0a21c2', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4ca3c29-a85d-41b2-a215-417d3265fc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4ca3c29-a85d-41b2-a215-417d3265fc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12512526-afa1-438c-9e65-6a91d84ebe0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:47 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Volume 93957d66-43a8-40d0-8344-ab6c2b0a21c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93957d66-43a8-40d0-8344-ab6c2b0a21c2', 'volume_size': 1} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1334630244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93957d66-43a8-40d0-8344-ab6c2b0a21c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e794868cd5194548a581033d1675d490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:47Z,use_quota=True,user_id='e4dc843304fb4087b731ecf86e4e7d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Creating volume 93957d66-43a8-40d0-8344-ab6c2b0a21c2 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:42:47 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-93957d66-43a8-40d0-8344-ab6c2b0a21c2 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-245b0a92-77c9-455b-9392-5894dd896e76 tempest-ProjectReaderTests-705535892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-245b0a92-77c9-455b-9392-5894dd896e76 tempest-ProjectReaderTests-705535892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-245b0a92-77c9-455b-9392-5894dd896e76 tempest-ProjectReaderTests-705535892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-245b0a92-77c9-455b-9392-5894dd896e76 tempest-ProjectReaderTests-705535892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-245b0a92-77c9-455b-9392-5894dd896e76 tempest-ProjectReaderTests-705535892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-245b0a92-77c9-455b-9392-5894dd896e76 tempest-ProjectReaderTests-705535892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:47 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-93957d66-43a8-40d0-8344-ab6c2b0a21c2 1073741824 Jul 10 04:42:47 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:47 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:42:47 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:48 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-245b0a92-77c9-455b-9392-5894dd896e76 tempest-ProjectReaderTests-705535892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.020s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:48 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-245b0a92-77c9-455b-9392-5894dd896e76 tempest-ProjectReaderTests-705535892 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:48 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-245b0a92-77c9-455b-9392-5894dd896e76 tempest-ProjectReaderTests-705535892 None] Deleted volume successfully. Jul 10 04:42:48 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-245b0a92-77c9-455b-9392-5894dd896e76 tempest-ProjectReaderTests-705535892 None] Lock "cinder-865c9bd9-5ac4-44c5-a11f-d0026724d635-delete_volume" released by "delete_volume" :: held 3.537s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:48 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-93957d66-43a8-40d0-8344-ab6c2b0a21c2 1073741824" returned: 0 in 1.138s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-93957d66-43a8-40d0-8344-ab6c2b0a21c2 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:48 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-93957d66-43a8-40d0-8344-ab6c2b0a21c2 Jul 10 04:42:48 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:48 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:42:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Flow 'volume_create_manager' (fbac0b03-e838-490d-a2aa-9dbb2d75a635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9266e4c5-8490-4908-aea1-4982d578482c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9266e4c5-8490-4908-aea1-4982d578482c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1814210132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542c786a-457b-4e71-a632-ff2abf3202d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d493bb242aae41b3a451777065f04c48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:49Z,use_quota=True,user_id='2a283cab8b634059a42cab5fb4777000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00c2686-98af-4faf-922b-66be83d2ae06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00c2686-98af-4faf-922b-66be83d2ae06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd18fdc-a3ba-44ee-a916-abe23b81deec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd18fdc-a3ba-44ee-a916-abe23b81deec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '542c786a-457b-4e71-a632-ff2abf3202d3', 'volume_name': 'volume-542c786a-457b-4e71-a632-ff2abf3202d3', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddaa1aa7-016d-4bb1-9b99-088e8150b382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddaa1aa7-016d-4bb1-9b99-088e8150b382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e3aaa0-9236-4401-81fe-e6a5a02f933f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:48 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Volume 542c786a-457b-4e71-a632-ff2abf3202d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-542c786a-457b-4e71-a632-ff2abf3202d3', 'volume_size': 1} Jul 10 04:42:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:49 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-93957d66-43a8-40d0-8344-ab6c2b0a21c2" returned: 0 in 0.812s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:42:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.288s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1814210132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542c786a-457b-4e71-a632-ff2abf3202d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d493bb242aae41b3a451777065f04c48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:49Z,use_quota=True,user_id='2a283cab8b634059a42cab5fb4777000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:42:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Creating volume 542c786a-457b-4e71-a632-ff2abf3202d3 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:42:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:42:49 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:42:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-542c786a-457b-4e71-a632-ff2abf3202d3 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12512526-afa1-438c-9e65-6a91d84ebe0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93957d66-43a8-40d0-8344-ab6c2b0a21c2', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:49 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-542c786a-457b-4e71-a632-ff2abf3202d3 1073741824 Jul 10 04:42:49 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e432436-36b1-4834-81d2-935af7a95f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:49 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Volume volume-93957d66-43a8-40d0-8344-ab6c2b0a21c2 (93957d66-43a8-40d0-8344-ab6c2b0a21c2): created successfully Jul 10 04:42:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e432436-36b1-4834-81d2-935af7a95f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Flow 'volume_create_manager' (f07c2d0c-b7a4-4c82-91f4-4544ded52d92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:49 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c30c783b-7685-4fbe-bcb6-0edc6690d0f5 tempest-VolumesTransfersV357Test-2046559405 None] Created volume successfully. Jul 10 04:42:50 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-542c786a-457b-4e71-a632-ff2abf3202d3 1073741824" returned: 0 in 1.095s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-542c786a-457b-4e71-a632-ff2abf3202d3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:50 devstack sudo[96245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-542c786a-457b-4e71-a632-ff2abf3202d3 Jul 10 04:42:50 devstack sudo[96245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:51 devstack sudo[96245]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-542c786a-457b-4e71-a632-ff2abf3202d3" returned: 0 in 0.824s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:51 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:42:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:51 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e3aaa0-9236-4401-81fe-e6a5a02f933f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-542c786a-457b-4e71-a632-ff2abf3202d3', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:51 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43951c6b-88eb-4685-a2e9-495994870f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:51 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Volume volume-542c786a-457b-4e71-a632-ff2abf3202d3 (542c786a-457b-4e71-a632-ff2abf3202d3): created successfully Jul 10 04:42:51 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43951c6b-88eb-4685-a2e9-495994870f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:51 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Flow 'volume_create_manager' (fbac0b03-e838-490d-a2aa-9dbb2d75a635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:51 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a3669964-e642-4f4d-8e50-e83af2736c55 tempest-VolumesTransfersV357Test-262785075 None] Transfer volume completed successfully. Jul 10 04:42:51 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d5f170d8-ccde-4e7e-83ad-52402e9977f5 tempest-ProjectReaderTests-705535892 None] Created volume successfully. Jul 10 04:42:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-76352b10-fd59-4ddc-8ad8-544daaaf6469 tempest-ProjectReaderTests-705535892 None] Acquiring lock "cinder-542c786a-457b-4e71-a632-ff2abf3202d3-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-76352b10-fd59-4ddc-8ad8-544daaaf6469 tempest-ProjectReaderTests-705535892 None] Lock "cinder-542c786a-457b-4e71-a632-ff2abf3202d3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-76352b10-fd59-4ddc-8ad8-544daaaf6469 tempest-ProjectReaderTests-705535892 None] Acquiring lock "cinder-quobyte-542c786a-457b-4e71-a632-ff2abf3202d3" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-76352b10-fd59-4ddc-8ad8-544daaaf6469 tempest-ProjectReaderTests-705535892 None] Lock "cinder-quobyte-542c786a-457b-4e71-a632-ff2abf3202d3" acquired by "delete_volume" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:52 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a86368a-a75c-4d7d-8e36-4c61ab2e40be]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-76352b10-fd59-4ddc-8ad8-544daaaf6469 tempest-ProjectReaderTests-705535892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-542c786a-457b-4e71-a632-ff2abf3202d3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:52 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-542c786a-457b-4e71-a632-ff2abf3202d3 Jul 10 04:42:52 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-903817ed-4ebb-45f9-a051-34b89d12141a tempest-VolumesTransfersV357Test-1231436335 None] Acquiring lock "cinder-93957d66-43a8-40d0-8344-ab6c2b0a21c2-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-903817ed-4ebb-45f9-a051-34b89d12141a tempest-VolumesTransfersV357Test-1231436335 None] Lock "cinder-93957d66-43a8-40d0-8344-ab6c2b0a21c2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-903817ed-4ebb-45f9-a051-34b89d12141a tempest-VolumesTransfersV357Test-1231436335 None] Acquiring lock "cinder-quobyte-93957d66-43a8-40d0-8344-ab6c2b0a21c2" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-903817ed-4ebb-45f9-a051-34b89d12141a tempest-VolumesTransfersV357Test-1231436335 None] Lock "cinder-quobyte-93957d66-43a8-40d0-8344-ab6c2b0a21c2" acquired by "delete_volume" :: waited 0.029s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:52 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa4a6f0-edd0-4b26-b08c-642cf20df1c1]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-903817ed-4ebb-45f9-a051-34b89d12141a tempest-VolumesTransfersV357Test-1231436335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-93957d66-43a8-40d0-8344-ab6c2b0a21c2 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:53 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-93957d66-43a8-40d0-8344-ab6c2b0a21c2 Jul 10 04:42:53 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:53 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-76352b10-fd59-4ddc-8ad8-544daaaf6469 tempest-ProjectReaderTests-705535892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-542c786a-457b-4e71-a632-ff2abf3202d3" returned: 0 in 1.284s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-76352b10-fd59-4ddc-8ad8-544daaaf6469 tempest-ProjectReaderTests-705535892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-542c786a-457b-4e71-a632-ff2abf3202d3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:53 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-542c786a-457b-4e71-a632-ff2abf3202d3 Jul 10 04:42:53 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:54 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-903817ed-4ebb-45f9-a051-34b89d12141a tempest-VolumesTransfersV357Test-1231436335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-93957d66-43a8-40d0-8344-ab6c2b0a21c2" returned: 0 in 1.194s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-903817ed-4ebb-45f9-a051-34b89d12141a tempest-VolumesTransfersV357Test-1231436335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-93957d66-43a8-40d0-8344-ab6c2b0a21c2 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:54 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-93957d66-43a8-40d0-8344-ab6c2b0a21c2 Jul 10 04:42:54 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:54 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-76352b10-fd59-4ddc-8ad8-544daaaf6469 tempest-ProjectReaderTests-705535892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-542c786a-457b-4e71-a632-ff2abf3202d3" returned: 0 in 0.780s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-76352b10-fd59-4ddc-8ad8-544daaaf6469 tempest-ProjectReaderTests-705535892 None] Lock "cinder-quobyte-542c786a-457b-4e71-a632-ff2abf3202d3" released by "delete_volume" :: held 2.134s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:54 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-76352b10-fd59-4ddc-8ad8-544daaaf6469 tempest-ProjectReaderTests-705535892 None] Created reservations ['b85b5ef3-2a63-4acc-8af7-1d5498eaae15', 'c0eaa270-841b-43a7-a5ca-329af1b03fa4', '6144815a-1f84-42b0-b37a-031c4f26a9ad', '2ab262a2-41eb-45be-ac81-46b0031ff439'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-76352b10-fd59-4ddc-8ad8-544daaaf6469 tempest-ProjectReaderTests-705535892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-76352b10-fd59-4ddc-8ad8-544daaaf6469 tempest-ProjectReaderTests-705535892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-76352b10-fd59-4ddc-8ad8-544daaaf6469 tempest-ProjectReaderTests-705535892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-76352b10-fd59-4ddc-8ad8-544daaaf6469 tempest-ProjectReaderTests-705535892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-76352b10-fd59-4ddc-8ad8-544daaaf6469 tempest-ProjectReaderTests-705535892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-76352b10-fd59-4ddc-8ad8-544daaaf6469 tempest-ProjectReaderTests-705535892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:54 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:42:54 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:54 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-903817ed-4ebb-45f9-a051-34b89d12141a tempest-VolumesTransfersV357Test-1231436335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-93957d66-43a8-40d0-8344-ab6c2b0a21c2" returned: 0 in 0.751s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-903817ed-4ebb-45f9-a051-34b89d12141a tempest-VolumesTransfersV357Test-1231436335 None] Lock "cinder-quobyte-93957d66-43a8-40d0-8344-ab6c2b0a21c2" released by "delete_volume" :: held 2.015s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:54 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-903817ed-4ebb-45f9-a051-34b89d12141a tempest-VolumesTransfersV357Test-1231436335 None] Created reservations ['f6eb1cf2-96ad-439b-9e66-0e563c490968', 'd2a704d1-81c5-4bfc-b053-977d843a507e', '4aaed941-7a31-418a-8373-fc1ec5107679', 'b0d4a286-15e3-49d1-a404-b71cd74cca87'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-903817ed-4ebb-45f9-a051-34b89d12141a tempest-VolumesTransfersV357Test-1231436335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-903817ed-4ebb-45f9-a051-34b89d12141a tempest-VolumesTransfersV357Test-1231436335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-903817ed-4ebb-45f9-a051-34b89d12141a tempest-VolumesTransfersV357Test-1231436335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-903817ed-4ebb-45f9-a051-34b89d12141a tempest-VolumesTransfersV357Test-1231436335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-903817ed-4ebb-45f9-a051-34b89d12141a tempest-VolumesTransfersV357Test-1231436335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-903817ed-4ebb-45f9-a051-34b89d12141a tempest-VolumesTransfersV357Test-1231436335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:55 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:42:55 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:55 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-76352b10-fd59-4ddc-8ad8-544daaaf6469 tempest-ProjectReaderTests-705535892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.765s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:55 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-76352b10-fd59-4ddc-8ad8-544daaaf6469 tempest-ProjectReaderTests-705535892 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:55 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-76352b10-fd59-4ddc-8ad8-544daaaf6469 tempest-ProjectReaderTests-705535892 None] Deleted volume successfully. Jul 10 04:42:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-76352b10-fd59-4ddc-8ad8-544daaaf6469 tempest-ProjectReaderTests-705535892 None] Lock "cinder-542c786a-457b-4e71-a632-ff2abf3202d3-delete_volume" released by "delete_volume" :: held 3.182s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:55 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-903817ed-4ebb-45f9-a051-34b89d12141a tempest-VolumesTransfersV357Test-1231436335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.735s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:55 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-903817ed-4ebb-45f9-a051-34b89d12141a tempest-VolumesTransfersV357Test-1231436335 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:55 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-903817ed-4ebb-45f9-a051-34b89d12141a tempest-VolumesTransfersV357Test-1231436335 None] Deleted volume successfully. Jul 10 04:42:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-903817ed-4ebb-45f9-a051-34b89d12141a tempest-VolumesTransfersV357Test-1231436335 None] Lock "cinder-93957d66-43a8-40d0-8344-ab6c2b0a21c2-delete_volume" released by "delete_volume" :: held 3.077s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Flow 'volume_create_manager' (e74cb592-7ce3-4ba3-ae7b-e5e87da97d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d456f04f-0e33-415a-8303-5aeaa0372a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d456f04f-0e33-415a-8303-5aeaa0372a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1862206053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c9905c7-862c-4163-b325-780c3709daa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03cb2bbe845b49239fb33365955feb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:56Z,use_quota=True,user_id='8df2c14d70354fa78c364729590e70fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bdf0053-136c-4b00-87e7-5f1ca85245a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bdf0053-136c-4b00-87e7-5f1ca85245a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e100d7f7-05e2-47a5-991c-ce4c0e02b011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e100d7f7-05e2-47a5-991c-ce4c0e02b011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c9905c7-862c-4163-b325-780c3709daa6', 'volume_name': 'volume-1c9905c7-862c-4163-b325-780c3709daa6', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b262f9f3-1a7f-4f05-92d6-87cb56482a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b262f9f3-1a7f-4f05-92d6-87cb56482a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2f6593-02a0-43cd-bb8e-3de80dba4370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:56 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Volume 1c9905c7-862c-4163-b325-780c3709daa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c9905c7-862c-4163-b325-780c3709daa6', 'volume_size': 1} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1862206053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c9905c7-862c-4163-b325-780c3709daa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03cb2bbe845b49239fb33365955feb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:56Z,use_quota=True,user_id='8df2c14d70354fa78c364729590e70fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Creating volume 1c9905c7-862c-4163-b325-780c3709daa6 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:42:56 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:56 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 1073741824 Jul 10 04:42:56 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Flow 'volume_create_manager' (fcc7257d-b23d-4871-851d-179d465758f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5120b53c-7dea-488c-bf6e-413c57433f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5120b53c-7dea-488c-bf6e-413c57433f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-476080248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa955a35-c827-46cf-9cd6-234179e118e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e794868cd5194548a581033d1675d490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:57Z,use_quota=True,user_id='e4dc843304fb4087b731ecf86e4e7d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ff31f61-4930-4ab3-8818-e52f54384731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ff31f61-4930-4ab3-8818-e52f54384731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a07e22-1693-4e76-9c73-706a65065bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a07e22-1693-4e76-9c73-706a65065bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa955a35-c827-46cf-9cd6-234179e118e7', 'volume_name': 'volume-aa955a35-c827-46cf-9cd6-234179e118e7', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5254120d-abd9-4d8c-abf6-bca9f3d145a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5254120d-abd9-4d8c-abf6-bca9f3d145a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73342f63-eb21-4895-aaa4-a3ef7c7630ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:56 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Volume aa955a35-c827-46cf-9cd6-234179e118e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa955a35-c827-46cf-9cd6-234179e118e7', 'volume_size': 1} Jul 10 04:42:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:57 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 1073741824" returned: 0 in 1.077s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:57 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 Jul 10 04:42:57 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:58 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6" returned: 0 in 0.930s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] <== create_volume: return (2064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:42:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.067s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.288s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-476080248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa955a35-c827-46cf-9cd6-234179e118e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e794868cd5194548a581033d1675d490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:57Z,use_quota=True,user_id='e4dc843304fb4087b731ecf86e4e7d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:42:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Creating volume aa955a35-c827-46cf-9cd6-234179e118e7 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:42:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:42:58 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:42:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aa955a35-c827-46cf-9cd6-234179e118e7 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2f6593-02a0-43cd-bb8e-3de80dba4370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c9905c7-862c-4163-b325-780c3709daa6', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:58 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aa955a35-c827-46cf-9cd6-234179e118e7 1073741824 Jul 10 04:42:58 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69964d3-4639-4cdb-9fd9-686466f2bf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:58 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Volume volume-1c9905c7-862c-4163-b325-780c3709daa6 (1c9905c7-862c-4163-b325-780c3709daa6): created successfully Jul 10 04:42:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69964d3-4639-4cdb-9fd9-686466f2bf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Flow 'volume_create_manager' (e74cb592-7ce3-4ba3-ae7b-e5e87da97d30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:58 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c4db7399-a13f-4fbd-b367-4e086fd4a9c4 tempest-TestStampPattern-1531341768 None] Created volume successfully. Jul 10 04:42:59 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aa955a35-c827-46cf-9cd6-234179e118e7 1073741824" returned: 0 in 1.021s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aa955a35-c827-46cf-9cd6-234179e118e7 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:59 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aa955a35-c827-46cf-9cd6-234179e118e7 Jul 10 04:42:59 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:00 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aa955a35-c827-46cf-9cd6-234179e118e7" returned: 0 in 0.738s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:43:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:43:00 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73342f63-eb21-4895-aaa4-a3ef7c7630ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa955a35-c827-46cf-9cd6-234179e118e7', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:00 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559803a5-0b42-4c09-8bf9-661faffc45bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:00 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Volume volume-aa955a35-c827-46cf-9cd6-234179e118e7 (aa955a35-c827-46cf-9cd6-234179e118e7): created successfully Jul 10 04:43:00 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559803a5-0b42-4c09-8bf9-661faffc45bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:00 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Flow 'volume_create_manager' (fcc7257d-b23d-4871-851d-179d465758f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:43:00 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-070d002d-f0d9-48fb-a639-7243483ae4d3 tempest-VolumesTransfersV357Test-2046559405 None] Created volume successfully. Jul 10 04:43:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-696c5ffb-e599-4b36-928e-995bb59f44b6 tempest-VolumesTransfersV357Test-1231436335 None] Acquiring lock "cinder-aa955a35-c827-46cf-9cd6-234179e118e7-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:43:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-696c5ffb-e599-4b36-928e-995bb59f44b6 tempest-VolumesTransfersV357Test-1231436335 None] Lock "cinder-aa955a35-c827-46cf-9cd6-234179e118e7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:43:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-696c5ffb-e599-4b36-928e-995bb59f44b6 tempest-VolumesTransfersV357Test-1231436335 None] Acquiring lock "cinder-quobyte-aa955a35-c827-46cf-9cd6-234179e118e7" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:43:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-696c5ffb-e599-4b36-928e-995bb59f44b6 tempest-VolumesTransfersV357Test-1231436335 None] Lock "cinder-quobyte-aa955a35-c827-46cf-9cd6-234179e118e7" acquired by "delete_volume" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:43:01 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7423337-4c41-40e5-aa0d-7fd84b78769b]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:43:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-696c5ffb-e599-4b36-928e-995bb59f44b6 tempest-VolumesTransfersV357Test-1231436335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aa955a35-c827-46cf-9cd6-234179e118e7 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:01 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aa955a35-c827-46cf-9cd6-234179e118e7 Jul 10 04:43:01 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:02 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-696c5ffb-e599-4b36-928e-995bb59f44b6 tempest-VolumesTransfersV357Test-1231436335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aa955a35-c827-46cf-9cd6-234179e118e7" returned: 0 in 0.996s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-696c5ffb-e599-4b36-928e-995bb59f44b6 tempest-VolumesTransfersV357Test-1231436335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aa955a35-c827-46cf-9cd6-234179e118e7 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:02 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aa955a35-c827-46cf-9cd6-234179e118e7 Jul 10 04:43:02 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:03 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-696c5ffb-e599-4b36-928e-995bb59f44b6 tempest-VolumesTransfersV357Test-1231436335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aa955a35-c827-46cf-9cd6-234179e118e7" returned: 0 in 0.898s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-696c5ffb-e599-4b36-928e-995bb59f44b6 tempest-VolumesTransfersV357Test-1231436335 None] Lock "cinder-quobyte-aa955a35-c827-46cf-9cd6-234179e118e7" released by "delete_volume" :: held 1.960s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:43:03 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-696c5ffb-e599-4b36-928e-995bb59f44b6 tempest-VolumesTransfersV357Test-1231436335 None] Created reservations ['cd06985b-a6fc-447f-aacd-c04a051bbe4c', '08f9d211-6c86-419e-b3d4-0c5538a060f4', '75f547ba-7ee2-4eb2-976e-8afae73afcbf', 'bf1c2849-a4ec-4ae3-a886-941af558788e'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:43:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-696c5ffb-e599-4b36-928e-995bb59f44b6 tempest-VolumesTransfersV357Test-1231436335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:43:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-696c5ffb-e599-4b36-928e-995bb59f44b6 tempest-VolumesTransfersV357Test-1231436335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:43:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-696c5ffb-e599-4b36-928e-995bb59f44b6 tempest-VolumesTransfersV357Test-1231436335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:43:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-696c5ffb-e599-4b36-928e-995bb59f44b6 tempest-VolumesTransfersV357Test-1231436335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:43:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-696c5ffb-e599-4b36-928e-995bb59f44b6 tempest-VolumesTransfersV357Test-1231436335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:43:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-696c5ffb-e599-4b36-928e-995bb59f44b6 tempest-VolumesTransfersV357Test-1231436335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:03 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:43:03 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:04 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-696c5ffb-e599-4b36-928e-995bb59f44b6 tempest-VolumesTransfersV357Test-1231436335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.010s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:04 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-696c5ffb-e599-4b36-928e-995bb59f44b6 tempest-VolumesTransfersV357Test-1231436335 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:43:04 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-696c5ffb-e599-4b36-928e-995bb59f44b6 tempest-VolumesTransfersV357Test-1231436335 None] Deleted volume successfully. Jul 10 04:43:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-696c5ffb-e599-4b36-928e-995bb59f44b6 tempest-VolumesTransfersV357Test-1231436335 None] Lock "cinder-aa955a35-c827-46cf-9cd6-234179e118e7-delete_volume" released by "delete_volume" :: held 3.213s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:43:13 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=86,cinder:UPDATE=110,cinder:INSERT=24,cinder:DELETE=10 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:43:14 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=69,cinder:INSERT=33,cinder:UPDATE=126,cinder:DELETE=10 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:43:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:43:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:43:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:43:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:43:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:43:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:43:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:15 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:43:15 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:16 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.048s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:43:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:43:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:43:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:43:24 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:43:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Flow 'volume_create_manager' (273ca0e8-ea76-4291-a08c-100b5a6c91cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:43:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f5d005-5d93-4a5c-9c50-786f5307bf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f5d005-5d93-4a5c-9c50-786f5307bf5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1469175000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc934b9730d2422099c1a7f4f2769042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:43:24Z,use_quota=True,user_id='dec1753e023242499e1bc9a9ecccdc7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d4c3fe-1909-488a-8856-ac992687569a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d4c3fe-1909-488a-8856-ac992687569a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00635833-d1ed-41f9-b00d-51277e97d863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00635833-d1ed-41f9-b00d-51277e97d863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d', 'volume_name': 'volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe16d971-aaf2-465a-952c-0d361f91068b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe16d971-aaf2-465a-952c-0d361f91068b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:24 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e964a6d-2818-4f34-a13c-b911b4c17f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:24 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Volume 9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d', 'volume_size': 1} Jul 10 04:43:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:43:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:43:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1469175000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc934b9730d2422099c1a7f4f2769042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:43:24Z,use_quota=True,user_id='dec1753e023242499e1bc9a9ecccdc7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:43:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Creating volume 9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:43:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:43:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:43:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:43:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:43:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:43:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:43:24 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:43:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:24 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d 1073741824 Jul 10 04:43:24 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:25 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d 1073741824" returned: 0 in 0.840s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:25 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d Jul 10 04:43:25 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:25 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d" returned: 0 in 0.686s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:43:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:43:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e964a6d-2818-4f34-a13c-b911b4c17f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (639db346-6933-42cc-b06a-fecf87eea102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:25 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Volume volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d (9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d): created successfully Jul 10 04:43:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (639db346-6933-42cc-b06a-fecf87eea102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Flow 'volume_create_manager' (273ca0e8-ea76-4291-a08c-100b5a6c91cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:43:25 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-9c572337-3030-4a6f-88a0-6a430ac7c01a tempest-VolumesActionsTest-1582281719 None] Created volume successfully. Jul 10 04:43:32 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:43:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Flow 'volume_create_manager' (ca6c3d88-ceaa-4829-ae95-4a0ef9ddba27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:43:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b70c37-41a9-4d2b-9cbf-67d6964befba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b70c37-41a9-4d2b-9cbf-67d6964befba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1814832368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7144ea34-0a8a-4ae6-8322-0838c81c743e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5e246d0421483a8b3dd2d6e7ec3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:43:32Z,use_quota=True,user_id='edae621172ca425b9b02983dc59c33fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff441e7-1aff-4c55-9e75-7f1cc49f4c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff441e7-1aff-4c55-9e75-7f1cc49f4c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca346d6e-800d-49dc-9dbe-7c1f5152460d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca346d6e-800d-49dc-9dbe-7c1f5152460d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7144ea34-0a8a-4ae6-8322-0838c81c743e', 'volume_name': 'volume-7144ea34-0a8a-4ae6-8322-0838c81c743e', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d74aaff-20ea-487a-964f-fea2b86c67b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d74aaff-20ea-487a-964f-fea2b86c67b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:32 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9336e6ec-3377-4098-b9ba-dcd63e7812bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:32 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Volume 7144ea34-0a8a-4ae6-8322-0838c81c743e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7144ea34-0a8a-4ae6-8322-0838c81c743e', 'volume_size': 1} Jul 10 04:43:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:43:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:43:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1814832368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7144ea34-0a8a-4ae6-8322-0838c81c743e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5e246d0421483a8b3dd2d6e7ec3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:43:32Z,use_quota=True,user_id='edae621172ca425b9b02983dc59c33fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:43:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Creating volume 7144ea34-0a8a-4ae6-8322-0838c81c743e {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:43:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:43:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:43:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:43:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:43:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:43:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:43:32 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:43:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7144ea34-0a8a-4ae6-8322-0838c81c743e 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:32 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7144ea34-0a8a-4ae6-8322-0838c81c743e 1073741824 Jul 10 04:43:32 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:33 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7144ea34-0a8a-4ae6-8322-0838c81c743e 1073741824" returned: 0 in 1.005s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7144ea34-0a8a-4ae6-8322-0838c81c743e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:33 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7144ea34-0a8a-4ae6-8322-0838c81c743e Jul 10 04:43:33 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:34 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7144ea34-0a8a-4ae6-8322-0838c81c743e" returned: 0 in 0.778s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:43:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:43:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9336e6ec-3377-4098-b9ba-dcd63e7812bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7144ea34-0a8a-4ae6-8322-0838c81c743e', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c12811-e15c-4480-82ac-2e496edba78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:34 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Volume volume-7144ea34-0a8a-4ae6-8322-0838c81c743e (7144ea34-0a8a-4ae6-8322-0838c81c743e): created successfully Jul 10 04:43:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c12811-e15c-4480-82ac-2e496edba78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Flow 'volume_create_manager' (ca6c3d88-ceaa-4829-ae95-4a0ef9ddba27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:43:34 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-3123900a-181a-4bdb-857f-5a157ba3adf5 tempest-AttachVolumeTestJSON-419527975 None] Created volume successfully. Jul 10 04:43:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-5e150e67-bf8b-48bc-94a3-58c2056b69a5 req-70ec72d9-bf63-4027-8cc2-11f4a840dce4 tempest-AttachVolumeTestJSON-419527975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:43:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-5e150e67-bf8b-48bc-94a3-58c2056b69a5 req-70ec72d9-bf63-4027-8cc2-11f4a840dce4 tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:43:38 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bb290f-2867-4e64-a022-c63c8ba930db]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:43:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-5e150e67-bf8b-48bc-94a3-58c2056b69a5 req-70ec72d9-bf63-4027-8cc2-11f4a840dce4 tempest-AttachVolumeTestJSON-419527975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7144ea34-0a8a-4ae6-8322-0838c81c743e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:38 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7144ea34-0a8a-4ae6-8322-0838c81c743e Jul 10 04:43:38 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-dd3d68c8-e8ac-48c3-ba90-8ca812a88c2e req-f0b7ef14-baca-463a-a695-bf1112220825 tempest-TestStampPattern-1531341768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:43:39 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-5e150e67-bf8b-48bc-94a3-58c2056b69a5 req-70ec72d9-bf63-4027-8cc2-11f4a840dce4 tempest-AttachVolumeTestJSON-419527975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7144ea34-0a8a-4ae6-8322-0838c81c743e" returned: 0 in 0.839s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-5e150e67-bf8b-48bc-94a3-58c2056b69a5 req-70ec72d9-bf63-4027-8cc2-11f4a840dce4 tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.857s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:43:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-dd3d68c8-e8ac-48c3-ba90-8ca812a88c2e req-f0b7ef14-baca-463a-a695-bf1112220825 tempest-TestStampPattern-1531341768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.666s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:43:39 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f4ff06-867c-4f01-b340-2ac06b469cce]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:43:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-dd3d68c8-e8ac-48c3-ba90-8ca812a88c2e req-f0b7ef14-baca-463a-a695-bf1112220825 tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-5e150e67-bf8b-48bc-94a3-58c2056b69a5 req-70ec72d9-bf63-4027-8cc2-11f4a840dce4 tempest-AttachVolumeTestJSON-419527975 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31', 'name': 'volume-7144ea34-0a8a-4ae6-8322-0838c81c743e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1def1cc4-ee84-42cf-bfed-d8f6161f13ad', 'enforce_multipath': True} {{(pid=87359) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4975}} Jul 10 04:43:39 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-5e150e67-bf8b-48bc-94a3-58c2056b69a5 req-70ec72d9-bf63-4027-8cc2-11f4a840dce4 tempest-AttachVolumeTestJSON-419527975 None] attachment_update completed successfully. Jul 10 04:43:39 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 Jul 10 04:43:39 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:40 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-dd3d68c8-e8ac-48c3-ba90-8ca812a88c2e req-f0b7ef14-baca-463a-a695-bf1112220825 tempest-TestStampPattern-1531341768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6" returned: 0 in 1.023s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-dd3d68c8-e8ac-48c3-ba90-8ca812a88c2e req-f0b7ef14-baca-463a-a695-bf1112220825 tempest-TestStampPattern-1531341768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.051s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:43:40 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-dd3d68c8-e8ac-48c3-ba90-8ca812a88c2e req-f0b7ef14-baca-463a-a695-bf1112220825 tempest-TestStampPattern-1531341768 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31', 'name': 'volume-1c9905c7-862c-4163-b325-780c3709daa6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5860251b-fbfa-477c-88df-8be4d7406874', 'enforce_multipath': True} {{(pid=87359) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4975}} Jul 10 04:43:40 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-dd3d68c8-e8ac-48c3-ba90-8ca812a88c2e req-f0b7ef14-baca-463a-a695-bf1112220825 tempest-TestStampPattern-1531341768 None] attachment_update completed successfully. Jul 10 04:43:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-159478e5-12f1-40e8-b987-bfebf6e406cd tempest-VolumesActionsTest-1582281719 None] Acquiring lock "cinder-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d" by "attach_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:43:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-159478e5-12f1-40e8-b987-bfebf6e406cd tempest-VolumesActionsTest-1582281719 None] Lock "cinder-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d" acquired by "attach_volume" :: waited 0.027s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:43:42 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-159478e5-12f1-40e8-b987-bfebf6e406cd tempest-VolumesActionsTest-1582281719 None] Attaching volume 9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d to instance 421186d9-e144-4288-b92d-826040cb07a0 at mountpoint /dev/vdb on host None. Jul 10 04:43:42 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-159478e5-12f1-40e8-b987-bfebf6e406cd tempest-VolumesActionsTest-1582281719 None] Attach volume completed successfully. Jul 10 04:43:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-159478e5-12f1-40e8-b987-bfebf6e406cd tempest-VolumesActionsTest-1582281719 None] Lock "cinder-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d" released by "attach_volume" :: held 0.097s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:43:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-77594510-0d2c-4375-abf4-459f91102179 tempest-VolumesActionsTest-1582281719 None] Acquiring lock "cinder-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d-detach_volume" by "detach_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:43:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-77594510-0d2c-4375-abf4-459f91102179 tempest-VolumesActionsTest-1582281719 None] Lock "cinder-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:43:42 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-77594510-0d2c-4375-abf4-459f91102179 tempest-VolumesActionsTest-1582281719 None] Detaching volume 9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d from instance 421186d9-e144-4288-b92d-826040cb07a0. Jul 10 04:43:42 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-77594510-0d2c-4375-abf4-459f91102179 tempest-VolumesActionsTest-1582281719 None] Detach volume completed successfully. Jul 10 04:43:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-77594510-0d2c-4375-abf4-459f91102179 tempest-VolumesActionsTest-1582281719 None] Lock "cinder-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d-detach_volume" released by "detach_volume" :: held 0.057s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:43:48 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-67f58a00-3601-440a-b33d-77d4c06dbeb3 req-0edf7865-2ca9-4138-ad28-cd39dda831b4 tempest-TestStampPattern-1531341768 None] Terminate volume connection completed successfully. Jul 10 04:43:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-67f58a00-3601-440a-b33d-77d4c06dbeb3 req-0edf7865-2ca9-4138-ad28-cd39dda831b4 tempest-TestStampPattern-1531341768 None] Deleting attachment 5860251b-fbfa-477c-88df-8be4d7406874. {{(pid=87359) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5106}} Jul 10 04:43:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-cf3c3d20-8699-417e-8739-348ec4017c2e tempest-TestStampPattern-1531341768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:43:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-cf3c3d20-8699-417e-8739-348ec4017c2e tempest-TestStampPattern-1531341768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:43:51 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-cf3c3d20-8699-417e-8739-348ec4017c2e tempest-TestStampPattern-1531341768 None] Creating offline snapshot 87445eab-3818-4d99-a43e-858e085afd3c of volume 1c9905c7-862c-4163-b325-780c3709daa6 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:43:51 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[6858a5be-72ec-4ee9-b7b0-c95efab301a4]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:43:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cf3c3d20-8699-417e-8739-348ec4017c2e tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:51 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 Jul 10 04:43:51 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:51 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cf3c3d20-8699-417e-8739-348ec4017c2e tempest-TestStampPattern-1531341768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6" returned: 0 in 0.786s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cf3c3d20-8699-417e-8739-348ec4017c2e tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:52 devstack sudo[97195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c 1G Jul 10 04:43:52 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:52 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cf3c3d20-8699-417e-8739-348ec4017c2e tempest-TestStampPattern-1531341768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c 1G" returned: 0 in 0.983s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cf3c3d20-8699-417e-8739-348ec4017c2e tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c9905c7-862c-4163-b325-780c3709daa6 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:53 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c9905c7-862c-4163-b325-780c3709daa6 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c Jul 10 04:43:53 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:53 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cf3c3d20-8699-417e-8739-348ec4017c2e tempest-TestStampPattern-1531341768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c9905c7-862c-4163-b325-780c3709daa6 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c" returned: 0 in 0.810s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:53 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-cf3c3d20-8699-417e-8739-348ec4017c2e tempest-TestStampPattern-1531341768 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c is being set with open permissions: ugo+rw Jul 10 04:43:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cf3c3d20-8699-417e-8739-348ec4017c2e tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:53 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c Jul 10 04:43:53 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:54 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cf3c3d20-8699-417e-8739-348ec4017c2e tempest-TestStampPattern-1531341768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c" returned: 0 in 0.665s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cf3c3d20-8699-417e-8739-348ec4017c2e tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:54 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.info Jul 10 04:43:54 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:55 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cf3c3d20-8699-417e-8739-348ec4017c2e tempest-TestStampPattern-1531341768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.info" returned: 0 in 0.659s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:55 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-cf3c3d20-8699-417e-8739-348ec4017c2e tempest-TestStampPattern-1531341768 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.info is being set with open permissions: ugo+rw Jul 10 04:43:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cf3c3d20-8699-417e-8739-348ec4017c2e tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:55 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.info Jul 10 04:43:55 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:55 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cf3c3d20-8699-417e-8739-348ec4017c2e tempest-TestStampPattern-1531341768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.info" returned: 0 in 0.739s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-cf3c3d20-8699-417e-8739-348ec4017c2e tempest-TestStampPattern-1531341768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.759s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:43:55 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-cf3c3d20-8699-417e-8739-348ec4017c2e tempest-TestStampPattern-1531341768 None] Create snapshot completed successfully Jul 10 04:44:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-07489372-2111-4411-a869-f082e287f80f tempest-VolumesActionsTest-1582281719 None] Acquiring lock "cinder-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d" by "attach_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:07 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-07489372-2111-4411-a869-f082e287f80f tempest-VolumesActionsTest-1582281719 None] Lock "cinder-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d" acquired by "attach_volume" :: waited 0.037s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:07 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-07489372-2111-4411-a869-f082e287f80f tempest-VolumesActionsTest-1582281719 None] Attaching volume 9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d to instance ade765d2-b627-491a-839c-aca9fd37d2c3 at mountpoint /dev/vdb on host None. Jul 10 04:44:07 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-07489372-2111-4411-a869-f082e287f80f tempest-VolumesActionsTest-1582281719 None] Attach volume completed successfully. Jul 10 04:44:07 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-07489372-2111-4411-a869-f082e287f80f tempest-VolumesActionsTest-1582281719 None] Lock "cinder-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d" released by "attach_volume" :: held 0.173s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:07 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c1c27a49-e97b-48a6-b0ca-83f2dc8d467e tempest-VolumesActionsTest-1582281719 None] Acquiring lock "cinder-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d-detach_volume" by "detach_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:07 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c1c27a49-e97b-48a6-b0ca-83f2dc8d467e tempest-VolumesActionsTest-1582281719 None] Lock "cinder-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:07 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c1c27a49-e97b-48a6-b0ca-83f2dc8d467e tempest-VolumesActionsTest-1582281719 None] Detaching volume 9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d from instance ade765d2-b627-491a-839c-aca9fd37d2c3. Jul 10 04:44:07 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c1c27a49-e97b-48a6-b0ca-83f2dc8d467e tempest-VolumesActionsTest-1582281719 None] Detach volume completed successfully. Jul 10 04:44:07 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c1c27a49-e97b-48a6-b0ca-83f2dc8d467e tempest-VolumesActionsTest-1582281719 None] Lock "cinder-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d-detach_volume" released by "detach_volume" :: held 0.085s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Flow 'volume_create_manager' (dcba00e8-0313-4224-88f0-2e9f7bbd294d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77deac5e-344d-4730-aee2-b2bb6c9e135e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77deac5e-344d-4730-aee2-b2bb6c9e135e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-861222699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3db3d54-e25a-447f-9d3d-04b641eeeb5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03cb2bbe845b49239fb33365955feb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=87445eab-3818-4d99-a43e-858e085afd3c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:44:08Z,use_quota=True,user_id='8df2c14d70354fa78c364729590e70fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ab7b9e-9019-45d6-8694-705cdd014a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ab7b9e-9019-45d6-8694-705cdd014a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2ea70e-6963-40b5-a1e8-2d3f80428b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2ea70e-6963-40b5-a1e8-2d3f80428b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd3db3d54-e25a-447f-9d3d-04b641eeeb5a', 'volume_name': 'volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a', 'volume_size': 1, 'snapshot_id': '87445eab-3818-4d99-a43e-858e085afd3c'}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7daf815-d67d-42a8-a3ab-e151c00d7316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7daf815-d67d-42a8-a3ab-e151c00d7316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e75fc39-0b84-4a4a-b373-4568f52f7796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:08 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Volume d3db3d54-e25a-447f-9d3d-04b641eeeb5a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a', 'volume_size': 1, 'snapshot_id': '87445eab-3818-4d99-a43e-858e085afd3c'} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Acquiring lock "cinder-quobyte-87445eab-3818-4d99-a43e-858e085afd3c-d3db3d54-e25a-447f-9d3d-04b641eeeb5a" by "_create_volume_from_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Lock "cinder-quobyte-87445eab-3818-4d99-a43e-858e085afd3c-d3db3d54-e25a-447f-9d3d-04b641eeeb5a" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Creating volume d3db3d54-e25a-447f-9d3d-04b641eeeb5a from snapshot 87445eab-3818-4d99-a43e-858e085afd3c {{(pid=87359) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Acquiring lock "cinder-quobyte-d3db3d54-e25a-447f-9d3d-04b641eeeb5a" by "_copy_volume_from_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Lock "cinder-quobyte-d3db3d54-e25a-447f-9d3d-04b641eeeb5a" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] snapshot: 87445eab-3818-4d99-a43e-858e085afd3c, volume: d3db3d54-e25a-447f-9d3d-04b641eeeb5a, {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a864a7-deef-426c-a445-126b556a350c]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:09 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c Jul 10 04:44:09 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:10 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c" returned: 0 in 1.085s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c9905c7-862c-4163-b325-780c3709daa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:44:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 04:44:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Creating direct copy from snapshot {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 04:44:10 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2a15b6-8893-4583-aa8d-e7b2c5a82380]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:10 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 Jul 10 04:44:10 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:11 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6" returned: 0 in 1.229s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:11 devstack cinder-volume[87359]: DEBUG cinder.utils [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Path /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a not found in is_blk_device check {{(pid=87359) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 04:44:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:11 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a Jul 10 04:44:11 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:44:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:44:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:44:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:16 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:44:16 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:17 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a" returned: 0 in 6.118s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:17 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddb1e76-45f2-49cf-9ea6-be7e53cdbfe9]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:17 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.698s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:17 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:44:17 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:44:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:44:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:44:17 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 Jul 10 04:44:17 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:18 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=32,cinder:UPDATE=18,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:44:18 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6" returned: 0 in 1.399s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:18 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6, size 1024.00 MB, duration 6.12 sec, destination /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:44:18 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Converted 1024.00 MB image at 167.25 MB/s Jul 10 04:44:18 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a is being set with open permissions: ugo+rw Jul 10 04:44:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:18 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=17,cinder:SELECT=38,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:44:18 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a Jul 10 04:44:18 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:19 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a" returned: 0 in 1.021s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Lock "cinder-quobyte-d3db3d54-e25a-447f-9d3d-04b641eeeb5a" released by "_copy_volume_from_snapshot" :: held 11.027s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Lock "cinder-quobyte-87445eab-3818-4d99-a43e-858e085afd3c-d3db3d54-e25a-447f-9d3d-04b641eeeb5a" released by "_create_volume_from_snapshot" :: held 11.074s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.096s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e75fc39-0b84-4a4a-b373-4568f52f7796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a', 'volume_size': 1, 'snapshot_id': '87445eab-3818-4d99-a43e-858e085afd3c'}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fdf677-95a6-4cd4-bd2f-960b63577de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:19 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Volume volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a (d3db3d54-e25a-447f-9d3d-04b641eeeb5a): created successfully Jul 10 04:44:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fdf677-95a6-4cd4-bd2f-960b63577de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Flow 'volume_create_manager' (dcba00e8-0313-4224-88f0-2e9f7bbd294d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:44:20 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-5b50b8ca-3145-4438-ac53-1c4d864746ad tempest-TestStampPattern-1531341768 None] Created volume successfully. Jul 10 04:44:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b330c0cd-7e60-4550-8cd7-4eca461a7750 tempest-VolumesActionsTest-1582281719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b330c0cd-7e60-4550-8cd7-4eca461a7750 tempest-VolumesActionsTest-1582281719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:20 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f11e952-65a2-4547-9b89-f82a91063bb3]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b330c0cd-7e60-4550-8cd7-4eca461a7750 tempest-VolumesActionsTest-1582281719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:20 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d Jul 10 04:44:20 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:21 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b330c0cd-7e60-4550-8cd7-4eca461a7750 tempest-VolumesActionsTest-1582281719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d" returned: 0 in 0.842s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:21 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f07f7ab-f93a-42f8-9e39-0d9c1ff0fffe]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b330c0cd-7e60-4550-8cd7-4eca461a7750 tempest-VolumesActionsTest-1582281719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:21 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d Jul 10 04:44:21 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:21 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b330c0cd-7e60-4550-8cd7-4eca461a7750 tempest-VolumesActionsTest-1582281719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d" returned: 0 in 0.850s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b330c0cd-7e60-4550-8cd7-4eca461a7750 tempest-VolumesActionsTest-1582281719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d /opt/stack/data/cinder/conversion/9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d.temp_image.c47bd14d-a7c2-418d-a21c-ff1d59e2aa7f7jbiyfwt.img {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:21 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d /opt/stack/data/cinder/conversion/9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d.temp_image.c47bd14d-a7c2-418d-a21c-ff1d59e2aa7f7jbiyfwt.img Jul 10 04:44:21 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:23 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-cce06a2c-3a25-409c-8fb8-f1a326f1f2e2 req-4383cb75-434b-449b-83b7-20bacf46b5d7 tempest-AttachVolumeTestJSON-419527975 None] Terminate volume connection completed successfully. Jul 10 04:44:23 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-cce06a2c-3a25-409c-8fb8-f1a326f1f2e2 req-4383cb75-434b-449b-83b7-20bacf46b5d7 tempest-AttachVolumeTestJSON-419527975 None] Deleting attachment 1def1cc4-ee84-42cf-bfed-d8f6161f13ad. {{(pid=87359) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5106}} Jul 10 04:44:28 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b330c0cd-7e60-4550-8cd7-4eca461a7750 tempest-VolumesActionsTest-1582281719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d /opt/stack/data/cinder/conversion/9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d.temp_image.c47bd14d-a7c2-418d-a21c-ff1d59e2aa7f7jbiyfwt.img" returned: 0 in 6.605s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:28 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b802f3-1f01-4a89-a493-5b9502d093be]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b330c0cd-7e60-4550-8cd7-4eca461a7750 tempest-VolumesActionsTest-1582281719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:28 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d Jul 10 04:44:28 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:29 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b330c0cd-7e60-4550-8cd7-4eca461a7750 tempest-VolumesActionsTest-1582281719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d" returned: 0 in 1.126s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:29 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-b330c0cd-7e60-4550-8cd7-4eca461a7750 tempest-VolumesActionsTest-1582281719 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d, size 1024.00 MB, duration 6.61 sec, destination /opt/stack/data/cinder/conversion/9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d.temp_image.c47bd14d-a7c2-418d-a21c-ff1d59e2aa7f7jbiyfwt.img {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:44:29 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-b330c0cd-7e60-4550-8cd7-4eca461a7750 tempest-VolumesActionsTest-1582281719 None] Converted 1024.00 MB image at 155.02 MB/s Jul 10 04:44:29 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-b330c0cd-7e60-4550-8cd7-4eca461a7750 tempest-VolumesActionsTest-1582281719 None] c47bd14d-a7c2-418d-a21c-ff1d59e2aa7f was raw, no need to convert to raw {{(pid=87359) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1192}} Jul 10 04:44:33 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:44:39 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=2,cinder:DELETE=1,cinder:SELECT=3 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:44:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b330c0cd-7e60-4550-8cd7-4eca461a7750 tempest-VolumesActionsTest-1582281719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.145s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:51 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b330c0cd-7e60-4550-8cd7-4eca461a7750 tempest-VolumesActionsTest-1582281719 None] Uploaded volume to glance image-id: c47bd14d-a7c2-418d-a21c-ff1d59e2aa7f. {{(pid=87359) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 04:44:51 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-b330c0cd-7e60-4550-8cd7-4eca461a7750 tempest-VolumesActionsTest-1582281719 None] Copy volume to image completed successfully. Jul 10 04:44:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:52 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2e23d0-f5bc-4ad8-88c1-034a67ba2523]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:53 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d Jul 10 04:44:53 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:53 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d" returned: 0 in 0.841s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:53 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1affbce-2e38-4470-a096-233b98b8ccb3]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:53 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d Jul 10 04:44:53 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:54 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d" returned: 0 in 0.753s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d /opt/stack/data/cinder/conversion/9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d.temp_image.c0f5b242-24c5-4cba-9628-16fbc70a01f5wy01s4gu.img {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:54 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d /opt/stack/data/cinder/conversion/9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d.temp_image.c0f5b242-24c5-4cba-9628-16fbc70a01f5wy01s4gu.img Jul 10 04:44:54 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:58 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d /opt/stack/data/cinder/conversion/9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d.temp_image.c0f5b242-24c5-4cba-9628-16fbc70a01f5wy01s4gu.img" returned: 0 in 4.466s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:58 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4f07ea-c4a7-4887-b490-e74c5db901b6]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:59 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d Jul 10 04:44:59 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:59 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d" returned: 0 in 0.944s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:59 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d, size 1024.00 MB, duration 4.47 sec, destination /opt/stack/data/cinder/conversion/9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d.temp_image.c0f5b242-24c5-4cba-9628-16fbc70a01f5wy01s4gu.img {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:44:59 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] Converted 1024.00 MB image at 229.19 MB/s Jul 10 04:44:59 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] c0f5b242-24c5-4cba-9628-16fbc70a01f5 was raw, converting to qcow2 {{(pid=87359) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1209}} Jul 10 04:44:59 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[95810309-8e98-4ba8-a853-3a9fcf2bb9c1]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d.temp_image.c0f5b242-24c5-4cba-9628-16fbc70a01f5wy01s4gu.img {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:00 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d.temp_image.c0f5b242-24c5-4cba-9628-16fbc70a01f5wy01s4gu.img Jul 10 04:45:00 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:00 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d.temp_image.c0f5b242-24c5-4cba-9628-16fbc70a01f5wy01s4gu.img" returned: 0 in 0.721s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d.temp_image.c0f5b242-24c5-4cba-9628-16fbc70a01f5wy01s4gu.img {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:00 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d.temp_image.c0f5b242-24c5-4cba-9628-16fbc70a01f5wy01s4gu.img Jul 10 04:45:00 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:01 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d.temp_image.c0f5b242-24c5-4cba-9628-16fbc70a01f5wy01s4gu.img" returned: 1 in 0.733s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d.temp_image.c0f5b242-24c5-4cba-9628-16fbc70a01f5wy01s4gu.img' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:45:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d.temp_image.c0f5b242-24c5-4cba-9628-16fbc70a01f5wy01s4gu.img /opt/stack/data/cinder/conversion/vol_upload_kntrlac1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:01 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d.temp_image.c0f5b242-24c5-4cba-9628-16fbc70a01f5wy01s4gu.img /opt/stack/data/cinder/conversion/vol_upload_kntrlac1 Jul 10 04:45:01 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:02 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d.temp_image.c0f5b242-24c5-4cba-9628-16fbc70a01f5wy01s4gu.img /opt/stack/data/cinder/conversion/vol_upload_kntrlac1" returned: 0 in 0.678s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:02 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] Image conversion details: src /opt/stack/data/cinder/conversion/9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d.temp_image.c0f5b242-24c5-4cba-9628-16fbc70a01f5wy01s4gu.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_kntrlac1 {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:45:02 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 10 04:45:02 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[28feb38c-5626-4985-bccb-4e7c8e4f4bb9]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kntrlac1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:02 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kntrlac1 Jul 10 04:45:02 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:02 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kntrlac1" returned: 0 in 0.791s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.351s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] Uploaded volume to glance image-id: c0f5b242-24c5-4cba-9628-16fbc70a01f5. {{(pid=87359) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 04:45:04 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-2a670ff5-b72f-44c6-9e09-96793222557c tempest-VolumesActionsTest-1582281719 None] Copy volume to image completed successfully. Jul 10 04:45:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d0422635-eb73-4b16-8b41-7b1e2bfbe0f5 tempest-VolumesActionsTest-1582281719 None] Acquiring lock "cinder-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d0422635-eb73-4b16-8b41-7b1e2bfbe0f5 tempest-VolumesActionsTest-1582281719 None] Lock "cinder-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d0422635-eb73-4b16-8b41-7b1e2bfbe0f5 tempest-VolumesActionsTest-1582281719 None] Acquiring lock "cinder-quobyte-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d0422635-eb73-4b16-8b41-7b1e2bfbe0f5 tempest-VolumesActionsTest-1582281719 None] Lock "cinder-quobyte-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d" acquired by "delete_volume" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:05 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[585befa4-671d-492c-bcfd-1e6d6bb8d2af]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0422635-eb73-4b16-8b41-7b1e2bfbe0f5 tempest-VolumesActionsTest-1582281719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:05 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d Jul 10 04:45:05 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:06 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0422635-eb73-4b16-8b41-7b1e2bfbe0f5 tempest-VolumesActionsTest-1582281719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d" returned: 0 in 0.869s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0422635-eb73-4b16-8b41-7b1e2bfbe0f5 tempest-VolumesActionsTest-1582281719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:06 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d Jul 10 04:45:06 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:06 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0422635-eb73-4b16-8b41-7b1e2bfbe0f5 tempest-VolumesActionsTest-1582281719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d" returned: 0 in 0.697s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d0422635-eb73-4b16-8b41-7b1e2bfbe0f5 tempest-VolumesActionsTest-1582281719 None] Lock "cinder-quobyte-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d" released by "delete_volume" :: held 1.616s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:06 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-d0422635-eb73-4b16-8b41-7b1e2bfbe0f5 tempest-VolumesActionsTest-1582281719 None] Created reservations ['deacb5f2-1350-4ae4-a259-ec93a4a76a5a', '94f8ec3e-e7fc-4618-b86b-cb87efd91307', 'a44ad3bd-966d-4cf8-a95c-1fe7d277c3de', 'dc9f14ce-47ef-4534-948a-531208343ef6'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:45:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d0422635-eb73-4b16-8b41-7b1e2bfbe0f5 tempest-VolumesActionsTest-1582281719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d0422635-eb73-4b16-8b41-7b1e2bfbe0f5 tempest-VolumesActionsTest-1582281719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d0422635-eb73-4b16-8b41-7b1e2bfbe0f5 tempest-VolumesActionsTest-1582281719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d0422635-eb73-4b16-8b41-7b1e2bfbe0f5 tempest-VolumesActionsTest-1582281719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d0422635-eb73-4b16-8b41-7b1e2bfbe0f5 tempest-VolumesActionsTest-1582281719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0422635-eb73-4b16-8b41-7b1e2bfbe0f5 tempest-VolumesActionsTest-1582281719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:06 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:45:06 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:07 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0422635-eb73-4b16-8b41-7b1e2bfbe0f5 tempest-VolumesActionsTest-1582281719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.718s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:07 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-d0422635-eb73-4b16-8b41-7b1e2bfbe0f5 tempest-VolumesActionsTest-1582281719 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:45:07 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d0422635-eb73-4b16-8b41-7b1e2bfbe0f5 tempest-VolumesActionsTest-1582281719 None] Deleted volume successfully. Jul 10 04:45:07 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d0422635-eb73-4b16-8b41-7b1e2bfbe0f5 tempest-VolumesActionsTest-1582281719 None] Lock "cinder-9da8b77e-6d6e-497b-b9f3-0cc71d7a4b3d-delete_volume" released by "delete_volume" :: held 2.555s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-7849ed0d-5b85-4a7e-9bd6-d9a507417e85 req-a748965a-f63b-4d0f-ad98-6ad704899a84 tempest-TestStampPattern-1531341768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-7849ed0d-5b85-4a7e-9bd6-d9a507417e85 req-a748965a-f63b-4d0f-ad98-6ad704899a84 tempest-TestStampPattern-1531341768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:11 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[314ed6bd-7dd9-45d8-8ee7-beda39ed0938]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-7849ed0d-5b85-4a7e-9bd6-d9a507417e85 req-a748965a-f63b-4d0f-ad98-6ad704899a84 tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:11 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a Jul 10 04:45:11 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:12 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-7849ed0d-5b85-4a7e-9bd6-d9a507417e85 req-a748965a-f63b-4d0f-ad98-6ad704899a84 tempest-TestStampPattern-1531341768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a" returned: 0 in 0.889s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-7849ed0d-5b85-4a7e-9bd6-d9a507417e85 req-a748965a-f63b-4d0f-ad98-6ad704899a84 tempest-TestStampPattern-1531341768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.916s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-7849ed0d-5b85-4a7e-9bd6-d9a507417e85 req-a748965a-f63b-4d0f-ad98-6ad704899a84 tempest-TestStampPattern-1531341768 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31', 'name': 'volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd772eef6-ca46-488b-8472-db9df9d84ee8', 'enforce_multipath': True} {{(pid=87359) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4975}} Jul 10 04:45:12 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-7849ed0d-5b85-4a7e-9bd6-d9a507417e85 req-a748965a-f63b-4d0f-ad98-6ad704899a84 tempest-TestStampPattern-1531341768 None] attachment_update completed successfully. Jul 10 04:45:14 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:45:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Flow 'volume_create_manager' (b15b22ef-ec48-49a7-ba10-83969272508c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61875ad2-6eaa-494c-8d08-e7b3a945077e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61875ad2-6eaa-494c-8d08-e7b3a945077e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1138786785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f69d55c-dc1a-4d8d-9955-ffcc77726744,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd597a61c3d84888b01921b8c1f90ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:14Z,use_quota=True,user_id='d6bc21e6b3de4677b43ec0e384ccb4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c007bb7-f858-4890-8092-8524df481290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c007bb7-f858-4890-8092-8524df481290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b734d9e9-3d5d-4fcf-be48-394f8f240350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b734d9e9-3d5d-4fcf-be48-394f8f240350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f69d55c-dc1a-4d8d-9955-ffcc77726744', 'volume_name': 'volume-0f69d55c-dc1a-4d8d-9955-ffcc77726744', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7dcd74-dda8-4104-bb4e-8f66f7f895d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7dcd74-dda8-4104-bb4e-8f66f7f895d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e8eb9b0-b71c-4197-a887-dce956c19d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:14 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Volume 0f69d55c-dc1a-4d8d-9955-ffcc77726744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f69d55c-dc1a-4d8d-9955-ffcc77726744', 'volume_size': 1} Jul 10 04:45:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1138786785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f69d55c-dc1a-4d8d-9955-ffcc77726744,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd597a61c3d84888b01921b8c1f90ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:14Z,use_quota=True,user_id='d6bc21e6b3de4677b43ec0e384ccb4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:45:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Creating volume 0f69d55c-dc1a-4d8d-9955-ffcc77726744 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:45:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:45:14 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:45:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0f69d55c-dc1a-4d8d-9955-ffcc77726744 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:14 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0f69d55c-dc1a-4d8d-9955-ffcc77726744 1073741824 Jul 10 04:45:14 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:15 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0f69d55c-dc1a-4d8d-9955-ffcc77726744 1073741824" returned: 0 in 0.995s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0f69d55c-dc1a-4d8d-9955-ffcc77726744 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:15 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0f69d55c-dc1a-4d8d-9955-ffcc77726744 Jul 10 04:45:15 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:45:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:15 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:45:15 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:16 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0f69d55c-dc1a-4d8d-9955-ffcc77726744" returned: 0 in 0.676s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:16 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:45:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e8eb9b0-b71c-4197-a887-dce956c19d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f69d55c-dc1a-4d8d-9955-ffcc77726744', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71b46af-d0f2-442e-995e-46479a78fe0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:16 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Volume volume-0f69d55c-dc1a-4d8d-9955-ffcc77726744 (0f69d55c-dc1a-4d8d-9955-ffcc77726744): created successfully Jul 10 04:45:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71b46af-d0f2-442e-995e-46479a78fe0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Flow 'volume_create_manager' (b15b22ef-ec48-49a7-ba10-83969272508c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:16 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-37fa0747-c1b1-46b2-a413-f4dc8810c470 tempest-VolumesListTestJSON-1780230408 None] Created volume successfully. Jul 10 04:45:16 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.711s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:45:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:45:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:45:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:45:16 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:45:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Flow 'volume_create_manager' (3eeb4bf1-d0f9-481e-b91b-5632e040f35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e74dc0-905e-4e73-ad94-2a8e425188a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e74dc0-905e-4e73-ad94-2a8e425188a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-279180428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d3c6d14-32f5-49ad-bace-e7173a013c6e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd597a61c3d84888b01921b8c1f90ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:17Z,use_quota=True,user_id='d6bc21e6b3de4677b43ec0e384ccb4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4543f50-1419-4b80-a340-eab0241e0643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4543f50-1419-4b80-a340-eab0241e0643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d90815-09c1-4daf-b5af-edc835014d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d90815-09c1-4daf-b5af-edc835014d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d3c6d14-32f5-49ad-bace-e7173a013c6e', 'volume_name': 'volume-7d3c6d14-32f5-49ad-bace-e7173a013c6e', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1813c470-bdfa-449d-a3bf-ab100ca91403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1813c470-bdfa-449d-a3bf-ab100ca91403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de15644-e3df-4b77-81bd-eac22fd898f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:17 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Volume 7d3c6d14-32f5-49ad-bace-e7173a013c6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d3c6d14-32f5-49ad-bace-e7173a013c6e', 'volume_size': 1} Jul 10 04:45:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-279180428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d3c6d14-32f5-49ad-bace-e7173a013c6e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd597a61c3d84888b01921b8c1f90ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:17Z,use_quota=True,user_id='d6bc21e6b3de4677b43ec0e384ccb4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:45:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Creating volume 7d3c6d14-32f5-49ad-bace-e7173a013c6e {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:45:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:45:17 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:45:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7d3c6d14-32f5-49ad-bace-e7173a013c6e 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:17 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7d3c6d14-32f5-49ad-bace-e7173a013c6e 1073741824 Jul 10 04:45:17 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:17 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7d3c6d14-32f5-49ad-bace-e7173a013c6e 1073741824" returned: 0 in 0.853s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7d3c6d14-32f5-49ad-bace-e7173a013c6e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:17 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7d3c6d14-32f5-49ad-bace-e7173a013c6e Jul 10 04:45:17 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:18 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7d3c6d14-32f5-49ad-bace-e7173a013c6e" returned: 0 in 0.650s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:45:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de15644-e3df-4b77-81bd-eac22fd898f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d3c6d14-32f5-49ad-bace-e7173a013c6e', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63eca3b2-5ca9-429e-9385-dd09e9ca5e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:18 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Volume volume-7d3c6d14-32f5-49ad-bace-e7173a013c6e (7d3c6d14-32f5-49ad-bace-e7173a013c6e): created successfully Jul 10 04:45:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63eca3b2-5ca9-429e-9385-dd09e9ca5e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Flow 'volume_create_manager' (3eeb4bf1-d0f9-481e-b91b-5632e040f35d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:18 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a63b5afe-430b-4a7b-8bd7-0f4ae72d810e tempest-VolumesListTestJSON-1780230408 None] Created volume successfully. Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Flow 'volume_create_manager' (64d4dd60-a10e-4261-961a-98c2fe4291d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fbe7513-0430-43df-8b04-846bbe57e32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fbe7513-0430-43df-8b04-846bbe57e32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-353380212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5223f0-7aea-425d-b676-9d3130339a3a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd597a61c3d84888b01921b8c1f90ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:20Z,use_quota=True,user_id='d6bc21e6b3de4677b43ec0e384ccb4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2baffaf5-c77a-4fba-9a5f-309a1d227378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2baffaf5-c77a-4fba-9a5f-309a1d227378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af171800-6399-4301-859b-09164403571b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af171800-6399-4301-859b-09164403571b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f5223f0-7aea-425d-b676-9d3130339a3a', 'volume_name': 'volume-4f5223f0-7aea-425d-b676-9d3130339a3a', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e0ba30-9b0e-47e3-a14f-14583423b0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e0ba30-9b0e-47e3-a14f-14583423b0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc260a83-6d7e-4e43-9feb-a7e156b0fca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:19 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Volume 4f5223f0-7aea-425d-b676-9d3130339a3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f5223f0-7aea-425d-b676-9d3130339a3a', 'volume_size': 1} Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-353380212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5223f0-7aea-425d-b676-9d3130339a3a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd597a61c3d84888b01921b8c1f90ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:20Z,use_quota=True,user_id='d6bc21e6b3de4677b43ec0e384ccb4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Creating volume 4f5223f0-7aea-425d-b676-9d3130339a3a {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:45:19 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4f5223f0-7aea-425d-b676-9d3130339a3a 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:19 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-1eac9812-c2ff-4c5f-8913-278a93748156 req-666636d1-6334-4839-bf16-ef9f1f7375d7 tempest-TestStampPattern-1531341768 None] Terminate volume connection completed successfully. Jul 10 04:45:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-1eac9812-c2ff-4c5f-8913-278a93748156 req-666636d1-6334-4839-bf16-ef9f1f7375d7 tempest-TestStampPattern-1531341768 None] Deleting attachment d772eef6-ca46-488b-8472-db9df9d84ee8. {{(pid=87359) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5106}} Jul 10 04:45:19 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4f5223f0-7aea-425d-b676-9d3130339a3a 1073741824 Jul 10 04:45:19 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:20 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4f5223f0-7aea-425d-b676-9d3130339a3a 1073741824" returned: 0 in 0.984s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4f5223f0-7aea-425d-b676-9d3130339a3a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:20 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4f5223f0-7aea-425d-b676-9d3130339a3a Jul 10 04:45:20 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:21 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4f5223f0-7aea-425d-b676-9d3130339a3a" returned: 0 in 0.695s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:45:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc260a83-6d7e-4e43-9feb-a7e156b0fca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f5223f0-7aea-425d-b676-9d3130339a3a', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6449a38-fd67-491e-9ded-d8e5aed6a910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:21 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Volume volume-4f5223f0-7aea-425d-b676-9d3130339a3a (4f5223f0-7aea-425d-b676-9d3130339a3a): created successfully Jul 10 04:45:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6449a38-fd67-491e-9ded-d8e5aed6a910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Flow 'volume_create_manager' (64d4dd60-a10e-4261-961a-98c2fe4291d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:21 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-dc2a370d-4e1b-4041-bdab-d794e520d2e2 tempest-VolumesListTestJSON-1780230408 None] Created volume successfully. Jul 10 04:45:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-fdc85b1c-aa23-4186-a8d0-3ae8a8859307 tempest-VolumesListTestJSON-1780230408 None] Acquiring lock "cinder-4f5223f0-7aea-425d-b676-9d3130339a3a-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-fdc85b1c-aa23-4186-a8d0-3ae8a8859307 tempest-VolumesListTestJSON-1780230408 None] Lock "cinder-4f5223f0-7aea-425d-b676-9d3130339a3a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-fdc85b1c-aa23-4186-a8d0-3ae8a8859307 tempest-VolumesListTestJSON-1780230408 None] Acquiring lock "cinder-quobyte-4f5223f0-7aea-425d-b676-9d3130339a3a" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-fdc85b1c-aa23-4186-a8d0-3ae8a8859307 tempest-VolumesListTestJSON-1780230408 None] Lock "cinder-quobyte-4f5223f0-7aea-425d-b676-9d3130339a3a" acquired by "delete_volume" :: waited 0.031s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:24 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[f975743b-ec13-41e2-9865-2f9ffe956109]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fdc85b1c-aa23-4186-a8d0-3ae8a8859307 tempest-VolumesListTestJSON-1780230408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4f5223f0-7aea-425d-b676-9d3130339a3a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:24 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4f5223f0-7aea-425d-b676-9d3130339a3a Jul 10 04:45:24 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:25 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fdc85b1c-aa23-4186-a8d0-3ae8a8859307 tempest-VolumesListTestJSON-1780230408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4f5223f0-7aea-425d-b676-9d3130339a3a" returned: 0 in 1.360s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fdc85b1c-aa23-4186-a8d0-3ae8a8859307 tempest-VolumesListTestJSON-1780230408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4f5223f0-7aea-425d-b676-9d3130339a3a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:25 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4f5223f0-7aea-425d-b676-9d3130339a3a Jul 10 04:45:25 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:26 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fdc85b1c-aa23-4186-a8d0-3ae8a8859307 tempest-VolumesListTestJSON-1780230408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4f5223f0-7aea-425d-b676-9d3130339a3a" returned: 0 in 0.727s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:26 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-fdc85b1c-aa23-4186-a8d0-3ae8a8859307 tempest-VolumesListTestJSON-1780230408 None] Lock "cinder-quobyte-4f5223f0-7aea-425d-b676-9d3130339a3a" released by "delete_volume" :: held 2.174s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:26 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-fdc85b1c-aa23-4186-a8d0-3ae8a8859307 tempest-VolumesListTestJSON-1780230408 None] Created reservations ['fc2dd58c-e89c-400a-a700-dc0206a58c4e', '2d8c86df-0826-4eb0-b373-b88a54df3db2', '310cc8fb-e911-4788-8640-b756618276b4', '90b69a9c-e551-4084-be1e-b9dcef74ede4'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:45:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fdc85b1c-aa23-4186-a8d0-3ae8a8859307 tempest-VolumesListTestJSON-1780230408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fdc85b1c-aa23-4186-a8d0-3ae8a8859307 tempest-VolumesListTestJSON-1780230408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fdc85b1c-aa23-4186-a8d0-3ae8a8859307 tempest-VolumesListTestJSON-1780230408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fdc85b1c-aa23-4186-a8d0-3ae8a8859307 tempest-VolumesListTestJSON-1780230408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fdc85b1c-aa23-4186-a8d0-3ae8a8859307 tempest-VolumesListTestJSON-1780230408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fdc85b1c-aa23-4186-a8d0-3ae8a8859307 tempest-VolumesListTestJSON-1780230408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:26 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:45:26 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:27 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fdc85b1c-aa23-4186-a8d0-3ae8a8859307 tempest-VolumesListTestJSON-1780230408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.683s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:27 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-fdc85b1c-aa23-4186-a8d0-3ae8a8859307 tempest-VolumesListTestJSON-1780230408 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:45:27 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-fdc85b1c-aa23-4186-a8d0-3ae8a8859307 tempest-VolumesListTestJSON-1780230408 None] Deleted volume successfully. Jul 10 04:45:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-fdc85b1c-aa23-4186-a8d0-3ae8a8859307 tempest-VolumesListTestJSON-1780230408 None] Lock "cinder-4f5223f0-7aea-425d-b676-9d3130339a3a-delete_volume" released by "delete_volume" :: held 3.097s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-56a690d1-dc87-4c05-bc8a-2c980dadec61 tempest-VolumesListTestJSON-1780230408 None] Acquiring lock "cinder-7d3c6d14-32f5-49ad-bace-e7173a013c6e-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-56a690d1-dc87-4c05-bc8a-2c980dadec61 tempest-VolumesListTestJSON-1780230408 None] Lock "cinder-7d3c6d14-32f5-49ad-bace-e7173a013c6e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-56a690d1-dc87-4c05-bc8a-2c980dadec61 tempest-VolumesListTestJSON-1780230408 None] Acquiring lock "cinder-quobyte-7d3c6d14-32f5-49ad-bace-e7173a013c6e" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-56a690d1-dc87-4c05-bc8a-2c980dadec61 tempest-VolumesListTestJSON-1780230408 None] Lock "cinder-quobyte-7d3c6d14-32f5-49ad-bace-e7173a013c6e" acquired by "delete_volume" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:27 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c751dd-6b64-419a-8e35-281b0f74be73]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-56a690d1-dc87-4c05-bc8a-2c980dadec61 tempest-VolumesListTestJSON-1780230408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7d3c6d14-32f5-49ad-bace-e7173a013c6e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:27 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7d3c6d14-32f5-49ad-bace-e7173a013c6e Jul 10 04:45:27 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:28 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-56a690d1-dc87-4c05-bc8a-2c980dadec61 tempest-VolumesListTestJSON-1780230408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7d3c6d14-32f5-49ad-bace-e7173a013c6e" returned: 0 in 0.829s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-56a690d1-dc87-4c05-bc8a-2c980dadec61 tempest-VolumesListTestJSON-1780230408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7d3c6d14-32f5-49ad-bace-e7173a013c6e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:28 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7d3c6d14-32f5-49ad-bace-e7173a013c6e Jul 10 04:45:28 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:29 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-56a690d1-dc87-4c05-bc8a-2c980dadec61 tempest-VolumesListTestJSON-1780230408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7d3c6d14-32f5-49ad-bace-e7173a013c6e" returned: 0 in 0.652s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-56a690d1-dc87-4c05-bc8a-2c980dadec61 tempest-VolumesListTestJSON-1780230408 None] Lock "cinder-quobyte-7d3c6d14-32f5-49ad-bace-e7173a013c6e" released by "delete_volume" :: held 1.529s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:29 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-56a690d1-dc87-4c05-bc8a-2c980dadec61 tempest-VolumesListTestJSON-1780230408 None] Created reservations ['bdfb3693-5429-4f5c-9fdc-0b0c2b73de19', 'd40b3c9a-92de-4b2f-9e5a-18f962b23f33', '6f4fac23-9fd9-48da-a48d-6da6afe66e53', 'd6314058-1f3d-447d-a094-7a257c018ec1'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:45:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-56a690d1-dc87-4c05-bc8a-2c980dadec61 tempest-VolumesListTestJSON-1780230408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-56a690d1-dc87-4c05-bc8a-2c980dadec61 tempest-VolumesListTestJSON-1780230408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-56a690d1-dc87-4c05-bc8a-2c980dadec61 tempest-VolumesListTestJSON-1780230408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-56a690d1-dc87-4c05-bc8a-2c980dadec61 tempest-VolumesListTestJSON-1780230408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-56a690d1-dc87-4c05-bc8a-2c980dadec61 tempest-VolumesListTestJSON-1780230408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-56a690d1-dc87-4c05-bc8a-2c980dadec61 tempest-VolumesListTestJSON-1780230408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:29 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:45:29 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8aea3d52-027a-4de1-9ed6-d82fe9670738 tempest-VolumesListTestJSON-1780230408 None] Acquiring lock "cinder-0f69d55c-dc1a-4d8d-9955-ffcc77726744-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8aea3d52-027a-4de1-9ed6-d82fe9670738 tempest-VolumesListTestJSON-1780230408 None] Lock "cinder-0f69d55c-dc1a-4d8d-9955-ffcc77726744-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8aea3d52-027a-4de1-9ed6-d82fe9670738 tempest-VolumesListTestJSON-1780230408 None] Acquiring lock "cinder-quobyte-0f69d55c-dc1a-4d8d-9955-ffcc77726744" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8aea3d52-027a-4de1-9ed6-d82fe9670738 tempest-VolumesListTestJSON-1780230408 None] Lock "cinder-quobyte-0f69d55c-dc1a-4d8d-9955-ffcc77726744" acquired by "delete_volume" :: waited 0.027s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:30 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da5486a-29c9-436a-a4af-a34dfcf9793f]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8aea3d52-027a-4de1-9ed6-d82fe9670738 tempest-VolumesListTestJSON-1780230408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0f69d55c-dc1a-4d8d-9955-ffcc77726744 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:30 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-56a690d1-dc87-4c05-bc8a-2c980dadec61 tempest-VolumesListTestJSON-1780230408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.810s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:30 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-56a690d1-dc87-4c05-bc8a-2c980dadec61 tempest-VolumesListTestJSON-1780230408 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:45:30 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-56a690d1-dc87-4c05-bc8a-2c980dadec61 tempest-VolumesListTestJSON-1780230408 None] Deleted volume successfully. Jul 10 04:45:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-56a690d1-dc87-4c05-bc8a-2c980dadec61 tempest-VolumesListTestJSON-1780230408 None] Lock "cinder-7d3c6d14-32f5-49ad-bace-e7173a013c6e-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-841350be-243a-4ae9-b741-41d59741f04c tempest-TestStampPattern-1531341768 None] Acquiring lock "cinder-d3db3d54-e25a-447f-9d3d-04b641eeeb5a-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-841350be-243a-4ae9-b741-41d59741f04c tempest-TestStampPattern-1531341768 None] Lock "cinder-d3db3d54-e25a-447f-9d3d-04b641eeeb5a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:30 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0f69d55c-dc1a-4d8d-9955-ffcc77726744 Jul 10 04:45:30 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-841350be-243a-4ae9-b741-41d59741f04c tempest-TestStampPattern-1531341768 None] Acquiring lock "cinder-quobyte-d3db3d54-e25a-447f-9d3d-04b641eeeb5a" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-841350be-243a-4ae9-b741-41d59741f04c tempest-TestStampPattern-1531341768 None] Lock "cinder-quobyte-d3db3d54-e25a-447f-9d3d-04b641eeeb5a" acquired by "delete_volume" :: waited 0.023s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:30 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c402b5-e08a-4030-8c23-fcb294308619]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-841350be-243a-4ae9-b741-41d59741f04c tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:30 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a Jul 10 04:45:30 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:31 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8aea3d52-027a-4de1-9ed6-d82fe9670738 tempest-VolumesListTestJSON-1780230408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0f69d55c-dc1a-4d8d-9955-ffcc77726744" returned: 0 in 1.106s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8aea3d52-027a-4de1-9ed6-d82fe9670738 tempest-VolumesListTestJSON-1780230408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0f69d55c-dc1a-4d8d-9955-ffcc77726744 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:31 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-841350be-243a-4ae9-b741-41d59741f04c tempest-TestStampPattern-1531341768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a" returned: 0 in 0.871s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-841350be-243a-4ae9-b741-41d59741f04c tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:31 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0f69d55c-dc1a-4d8d-9955-ffcc77726744 Jul 10 04:45:31 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:31 devstack sudo[98997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a Jul 10 04:45:31 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:31 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8aea3d52-027a-4de1-9ed6-d82fe9670738 tempest-VolumesListTestJSON-1780230408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0f69d55c-dc1a-4d8d-9955-ffcc77726744" returned: 0 in 0.713s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8aea3d52-027a-4de1-9ed6-d82fe9670738 tempest-VolumesListTestJSON-1780230408 None] Lock "cinder-quobyte-0f69d55c-dc1a-4d8d-9955-ffcc77726744" released by "delete_volume" :: held 1.885s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:32 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-841350be-243a-4ae9-b741-41d59741f04c tempest-TestStampPattern-1531341768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-d3db3d54-e25a-447f-9d3d-04b641eeeb5a" returned: 0 in 0.751s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-841350be-243a-4ae9-b741-41d59741f04c tempest-TestStampPattern-1531341768 None] Lock "cinder-quobyte-d3db3d54-e25a-447f-9d3d-04b641eeeb5a" released by "delete_volume" :: held 1.686s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:32 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-8aea3d52-027a-4de1-9ed6-d82fe9670738 tempest-VolumesListTestJSON-1780230408 None] Created reservations ['3d0d152e-1291-4cf3-b1cf-c4f3c98e8109', 'fcd3b79d-84bd-4fee-a097-0185c3f4d4fb', '7aa01cec-3f0c-4fe5-89b0-418b53f65d2c', '1d630888-ccf2-44f7-90ca-85e69e34f8c5'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:45:32 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-841350be-243a-4ae9-b741-41d59741f04c tempest-TestStampPattern-1531341768 None] Created reservations ['8077db7f-0dd5-43c1-9a5c-7211bc621078', 'ba00a893-6666-4870-9a3a-a30d46fab67c', '8961eefe-7fe3-4b50-9562-676f5a7ea811', 'fcc6c27b-7c0b-4aca-94fa-e8d947f227d0'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:45:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8aea3d52-027a-4de1-9ed6-d82fe9670738 tempest-VolumesListTestJSON-1780230408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8aea3d52-027a-4de1-9ed6-d82fe9670738 tempest-VolumesListTestJSON-1780230408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8aea3d52-027a-4de1-9ed6-d82fe9670738 tempest-VolumesListTestJSON-1780230408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8aea3d52-027a-4de1-9ed6-d82fe9670738 tempest-VolumesListTestJSON-1780230408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8aea3d52-027a-4de1-9ed6-d82fe9670738 tempest-VolumesListTestJSON-1780230408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8aea3d52-027a-4de1-9ed6-d82fe9670738 tempest-VolumesListTestJSON-1780230408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:32 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:45:32 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-841350be-243a-4ae9-b741-41d59741f04c tempest-TestStampPattern-1531341768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-841350be-243a-4ae9-b741-41d59741f04c tempest-TestStampPattern-1531341768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-841350be-243a-4ae9-b741-41d59741f04c tempest-TestStampPattern-1531341768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-841350be-243a-4ae9-b741-41d59741f04c tempest-TestStampPattern-1531341768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-841350be-243a-4ae9-b741-41d59741f04c tempest-TestStampPattern-1531341768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-841350be-243a-4ae9-b741-41d59741f04c tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:32 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:45:32 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:33 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-841350be-243a-4ae9-b741-41d59741f04c tempest-TestStampPattern-1531341768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.033s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:33 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-841350be-243a-4ae9-b741-41d59741f04c tempest-TestStampPattern-1531341768 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:45:33 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-841350be-243a-4ae9-b741-41d59741f04c tempest-TestStampPattern-1531341768 None] Deleted volume successfully. Jul 10 04:45:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-841350be-243a-4ae9-b741-41d59741f04c tempest-TestStampPattern-1531341768 None] Lock "cinder-d3db3d54-e25a-447f-9d3d-04b641eeeb5a-delete_volume" released by "delete_volume" :: held 3.110s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f3c55194-5f6a-46e2-a1df-88224eca7ce5 tempest-TestStampPattern-1531341768 None] Acquiring lock "cinder-87445eab-3818-4d99-a43e-858e085afd3c-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f3c55194-5f6a-46e2-a1df-88224eca7ce5 tempest-TestStampPattern-1531341768 None] Lock "cinder-87445eab-3818-4d99-a43e-858e085afd3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f3c55194-5f6a-46e2-a1df-88224eca7ce5 tempest-TestStampPattern-1531341768 None] Acquiring lock "cinder-quobyte-1c9905c7-862c-4163-b325-780c3709daa6" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f3c55194-5f6a-46e2-a1df-88224eca7ce5 tempest-TestStampPattern-1531341768 None] Lock "cinder-quobyte-1c9905c7-862c-4163-b325-780c3709daa6" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f3c55194-5f6a-46e2-a1df-88224eca7ce5 tempest-TestStampPattern-1531341768 None] Acquiring lock "cinder-quobyte-87445eab-3818-4d99-a43e-858e085afd3c" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f3c55194-5f6a-46e2-a1df-88224eca7ce5 tempest-TestStampPattern-1531341768 None] Lock "cinder-quobyte-87445eab-3818-4d99-a43e-858e085afd3c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-f3c55194-5f6a-46e2-a1df-88224eca7ce5 tempest-TestStampPattern-1531341768 None] Deleting offline snapshot 87445eab-3818-4d99-a43e-858e085afd3c of volume 1c9905c7-862c-4163-b325-780c3709daa6 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:45:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-f3c55194-5f6a-46e2-a1df-88224eca7ce5 tempest-TestStampPattern-1531341768 None] snapshot_file for this snap is: volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:45:33 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7bcd83-0fa3-4e1f-8b52-e719dd62e1ee]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f3c55194-5f6a-46e2-a1df-88224eca7ce5 tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:33 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8aea3d52-027a-4de1-9ed6-d82fe9670738 tempest-VolumesListTestJSON-1780230408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.378s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:33 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-8aea3d52-027a-4de1-9ed6-d82fe9670738 tempest-VolumesListTestJSON-1780230408 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:45:33 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-8aea3d52-027a-4de1-9ed6-d82fe9670738 tempest-VolumesListTestJSON-1780230408 None] Deleted volume successfully. Jul 10 04:45:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8aea3d52-027a-4de1-9ed6-d82fe9670738 tempest-VolumesListTestJSON-1780230408 None] Lock "cinder-0f69d55c-dc1a-4d8d-9955-ffcc77726744-delete_volume" released by "delete_volume" :: held 3.619s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:33 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c Jul 10 04:45:33 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:34 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f3c55194-5f6a-46e2-a1df-88224eca7ce5 tempest-TestStampPattern-1531341768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c" returned: 0 in 0.944s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-f3c55194-5f6a-46e2-a1df-88224eca7ce5 tempest-TestStampPattern-1531341768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c9905c7-862c-4163-b325-780c3709daa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:45:34 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ac2a8d-43ec-4c40-87e0-59e6e93412c8]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f3c55194-5f6a-46e2-a1df-88224eca7ce5 tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:34 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 Jul 10 04:45:34 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:35 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f3c55194-5f6a-46e2-a1df-88224eca7ce5 tempest-TestStampPattern-1531341768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6" returned: 0 in 0.808s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f3c55194-5f6a-46e2-a1df-88224eca7ce5 tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:35 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c Jul 10 04:45:35 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Flow 'volume_create_manager' (5568b8ff-a1c0-4eae-a418-c0976a1437a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb9fe2b-7d93-43a5-89de-76cf809ddd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:36 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb9fe2b-7d93-43a5-89de-76cf809ddd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1844189453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b320f1-b378-4b56-af9f-af4f5d7ed986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28832b4779b1423cb8cc80d8055116f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:36Z,use_quota=True,user_id='85ea54b5a0eb45c79c44e95cd8a9ae0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2fc7fa-f476-4f7f-a592-88145d39bbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2fc7fa-f476-4f7f-a592-88145d39bbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b39233-a5c6-4ab3-aa34-64b409b557f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b39233-a5c6-4ab3-aa34-64b409b557f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7b320f1-b378-4b56-af9f-af4f5d7ed986', 'volume_name': 'volume-c7b320f1-b378-4b56-af9f-af4f5d7ed986', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6557173-b7e2-43f3-ba64-61afd6fbae69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6557173-b7e2-43f3-ba64-61afd6fbae69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb38d1f9-4a48-4786-a72f-2a6343a7e20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:36 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Volume c7b320f1-b378-4b56-af9f-af4f5d7ed986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7b320f1-b378-4b56-af9f-af4f5d7ed986', 'volume_size': 1} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1844189453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b320f1-b378-4b56-af9f-af4f5d7ed986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28832b4779b1423cb8cc80d8055116f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:36Z,use_quota=True,user_id='85ea54b5a0eb45c79c44e95cd8a9ae0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Creating volume c7b320f1-b378-4b56-af9f-af4f5d7ed986 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:45:36 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c7b320f1-b378-4b56-af9f-af4f5d7ed986 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f3c55194-5f6a-46e2-a1df-88224eca7ce5 tempest-TestStampPattern-1531341768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c" returned: 0 in 0.848s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f3c55194-5f6a-46e2-a1df-88224eca7ce5 tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:36 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c7b320f1-b378-4b56-af9f-af4f5d7ed986 1073741824 Jul 10 04:45:36 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:36 devstack sudo[99027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c Jul 10 04:45:36 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:36 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f3c55194-5f6a-46e2-a1df-88224eca7ce5 tempest-TestStampPattern-1531341768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6.87445eab-3818-4d99-a43e-858e085afd3c" returned: 0 in 0.680s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f3c55194-5f6a-46e2-a1df-88224eca7ce5 tempest-TestStampPattern-1531341768 None] Lock "cinder-quobyte-87445eab-3818-4d99-a43e-858e085afd3c" released by "_delete_snapshot" :: held 3.428s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f3c55194-5f6a-46e2-a1df-88224eca7ce5 tempest-TestStampPattern-1531341768 None] Lock "cinder-quobyte-1c9905c7-862c-4163-b325-780c3709daa6" released by "delete_snapshot" :: held 3.456s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:37 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-f3c55194-5f6a-46e2-a1df-88224eca7ce5 tempest-TestStampPattern-1531341768 None] Created reservations ['c1e30ecc-57c7-4728-84cf-08c93af15fe5', '16e4b9bd-7ab7-4548-bc3f-ca88b9424743', 'c09e50f5-55a7-466f-89a3-5d4810c0acf0', '6b35b2c2-5bb9-41ba-9804-9779186156bb'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:45:37 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-f3c55194-5f6a-46e2-a1df-88224eca7ce5 tempest-TestStampPattern-1531341768 None] Delete snapshot completed successfully. Jul 10 04:45:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f3c55194-5f6a-46e2-a1df-88224eca7ce5 tempest-TestStampPattern-1531341768 None] Lock "cinder-87445eab-3818-4d99-a43e-858e085afd3c-delete_snapshot" released by "delete_snapshot" :: held 3.663s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:37 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c7b320f1-b378-4b56-af9f-af4f5d7ed986 1073741824" returned: 0 in 0.937s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c7b320f1-b378-4b56-af9f-af4f5d7ed986 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:37 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c7b320f1-b378-4b56-af9f-af4f5d7ed986 Jul 10 04:45:37 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:37 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c7b320f1-b378-4b56-af9f-af4f5d7ed986" returned: 0 in 0.691s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:45:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb38d1f9-4a48-4786-a72f-2a6343a7e20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b320f1-b378-4b56-af9f-af4f5d7ed986', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3564fe39-20bb-4b61-ab86-0b4d0364cb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:37 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Volume volume-c7b320f1-b378-4b56-af9f-af4f5d7ed986 (c7b320f1-b378-4b56-af9f-af4f5d7ed986): created successfully Jul 10 04:45:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3564fe39-20bb-4b61-ab86-0b4d0364cb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Flow 'volume_create_manager' (5568b8ff-a1c0-4eae-a418-c0976a1437a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:37 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-4913bad8-9c1c-44d5-9b68-584f6570b0e7 tempest-VolumesNegativeTest-1128226326 None] Created volume successfully. Jul 10 04:45:46 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-851f70e0-a8e1-41bb-a256-06851fd4e56c tempest-TestStampPattern-1531341768 None] Acquiring lock "cinder-1c9905c7-862c-4163-b325-780c3709daa6-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:46 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-851f70e0-a8e1-41bb-a256-06851fd4e56c tempest-TestStampPattern-1531341768 None] Lock "cinder-1c9905c7-862c-4163-b325-780c3709daa6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:46 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=60,cinder:SELECT=45,cinder:INSERT=10,cinder:DELETE=4 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:45:46 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-851f70e0-a8e1-41bb-a256-06851fd4e56c tempest-TestStampPattern-1531341768 None] Acquiring lock "cinder-quobyte-1c9905c7-862c-4163-b325-780c3709daa6" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:46 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-851f70e0-a8e1-41bb-a256-06851fd4e56c tempest-TestStampPattern-1531341768 None] Lock "cinder-quobyte-1c9905c7-862c-4163-b325-780c3709daa6" acquired by "delete_volume" :: waited 0.025s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:46 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[9561d7f9-553a-47d8-9fd7-4e5bcf689417]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-851f70e0-a8e1-41bb-a256-06851fd4e56c tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:46 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 Jul 10 04:45:46 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:47 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-851f70e0-a8e1-41bb-a256-06851fd4e56c tempest-TestStampPattern-1531341768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6" returned: 0 in 0.846s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-851f70e0-a8e1-41bb-a256-06851fd4e56c tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:47 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6 Jul 10 04:45:47 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:47 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-851f70e0-a8e1-41bb-a256-06851fd4e56c tempest-TestStampPattern-1531341768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1c9905c7-862c-4163-b325-780c3709daa6" returned: 0 in 0.683s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-851f70e0-a8e1-41bb-a256-06851fd4e56c tempest-TestStampPattern-1531341768 None] Lock "cinder-quobyte-1c9905c7-862c-4163-b325-780c3709daa6" released by "delete_volume" :: held 1.607s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:48 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-851f70e0-a8e1-41bb-a256-06851fd4e56c tempest-TestStampPattern-1531341768 None] Created reservations ['f2918751-12d4-40a2-b6d6-92c4a02f5438', 'd7a817e8-c345-4166-b5d2-60dbd198c28e', 'd3100800-b63a-4e99-a623-c630d89e6079', '2ece0364-166b-4b53-ad16-8f03f30635fd'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:45:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-851f70e0-a8e1-41bb-a256-06851fd4e56c tempest-TestStampPattern-1531341768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-851f70e0-a8e1-41bb-a256-06851fd4e56c tempest-TestStampPattern-1531341768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-851f70e0-a8e1-41bb-a256-06851fd4e56c tempest-TestStampPattern-1531341768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-851f70e0-a8e1-41bb-a256-06851fd4e56c tempest-TestStampPattern-1531341768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-851f70e0-a8e1-41bb-a256-06851fd4e56c tempest-TestStampPattern-1531341768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-851f70e0-a8e1-41bb-a256-06851fd4e56c tempest-TestStampPattern-1531341768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:48 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:45:48 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:48 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-851f70e0-a8e1-41bb-a256-06851fd4e56c tempest-TestStampPattern-1531341768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.723s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:48 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-851f70e0-a8e1-41bb-a256-06851fd4e56c tempest-TestStampPattern-1531341768 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:45:48 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-851f70e0-a8e1-41bb-a256-06851fd4e56c tempest-TestStampPattern-1531341768 None] Deleted volume successfully. Jul 10 04:45:48 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-851f70e0-a8e1-41bb-a256-06851fd4e56c tempest-TestStampPattern-1531341768 None] Lock "cinder-1c9905c7-862c-4163-b325-780c3709daa6-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=55,cinder:UPDATE=69,cinder:INSERT=19,cinder:DELETE=5 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Flow 'volume_create_manager' (6d127949-fbf1-4c26-9e9d-9d475472eaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b095c4fe-94dc-4dad-8bda-3c9f44d8b6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b095c4fe-94dc-4dad-8bda-3c9f44d8b6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1809228824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407dcae8-f5e0-420e-9161-06e9d72d2cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5e246d0421483a8b3dd2d6e7ec3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:52Z,use_quota=True,user_id='edae621172ca425b9b02983dc59c33fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (856fb329-82aa-45a4-911b-88b8bd543835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (856fb329-82aa-45a4-911b-88b8bd543835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d6c8da-e586-4b98-9032-c230f7fef88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d6c8da-e586-4b98-9032-c230f7fef88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '407dcae8-f5e0-420e-9161-06e9d72d2cda', 'volume_name': 'volume-407dcae8-f5e0-420e-9161-06e9d72d2cda', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423346ed-9354-431a-91ac-2d87cc3e5bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423346ed-9354-431a-91ac-2d87cc3e5bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f210bb1f-3b24-4f47-b92d-db9e1f4f3067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:51 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Volume 407dcae8-f5e0-420e-9161-06e9d72d2cda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-407dcae8-f5e0-420e-9161-06e9d72d2cda', 'volume_size': 1} Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1809228824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407dcae8-f5e0-420e-9161-06e9d72d2cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5e246d0421483a8b3dd2d6e7ec3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:52Z,use_quota=True,user_id='edae621172ca425b9b02983dc59c33fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Creating volume 407dcae8-f5e0-420e-9161-06e9d72d2cda {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:45:51 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:45:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-407dcae8-f5e0-420e-9161-06e9d72d2cda 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:51 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-407dcae8-f5e0-420e-9161-06e9d72d2cda 1073741824 Jul 10 04:45:51 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:53 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-407dcae8-f5e0-420e-9161-06e9d72d2cda 1073741824" returned: 0 in 1.313s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-407dcae8-f5e0-420e-9161-06e9d72d2cda {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:53 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-407dcae8-f5e0-420e-9161-06e9d72d2cda Jul 10 04:45:53 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:54 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-407dcae8-f5e0-420e-9161-06e9d72d2cda" returned: 0 in 1.076s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] <== create_volume: return (2440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:45:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.443s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f210bb1f-3b24-4f47-b92d-db9e1f4f3067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-407dcae8-f5e0-420e-9161-06e9d72d2cda', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f83b46-58cb-49ec-a566-e19075015775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:54 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Volume volume-407dcae8-f5e0-420e-9161-06e9d72d2cda (407dcae8-f5e0-420e-9161-06e9d72d2cda): created successfully Jul 10 04:45:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f83b46-58cb-49ec-a566-e19075015775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Flow 'volume_create_manager' (6d127949-fbf1-4c26-9e9d-9d475472eaa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:54 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-70b486e2-e79d-4bcb-9bc6-d1d36a9ba75a tempest-AttachVolumeTestJSON-419527975 None] Created volume successfully. Jul 10 04:45:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-2f149e6e-a244-4ac6-8b90-d5f53d470657 req-91ee6cd3-801f-4d7d-bc9b-1f30401b23c2 tempest-AttachVolumeTestJSON-419527975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-2f149e6e-a244-4ac6-8b90-d5f53d470657 req-91ee6cd3-801f-4d7d-bc9b-1f30401b23c2 tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:58 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9de1faf-7d4e-4912-9de8-c9214e0c90dc]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-2f149e6e-a244-4ac6-8b90-d5f53d470657 req-91ee6cd3-801f-4d7d-bc9b-1f30401b23c2 tempest-AttachVolumeTestJSON-419527975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-407dcae8-f5e0-420e-9161-06e9d72d2cda {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:58 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-407dcae8-f5e0-420e-9161-06e9d72d2cda Jul 10 04:45:58 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:59 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-2f149e6e-a244-4ac6-8b90-d5f53d470657 req-91ee6cd3-801f-4d7d-bc9b-1f30401b23c2 tempest-AttachVolumeTestJSON-419527975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-407dcae8-f5e0-420e-9161-06e9d72d2cda" returned: 0 in 0.794s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-2f149e6e-a244-4ac6-8b90-d5f53d470657 req-91ee6cd3-801f-4d7d-bc9b-1f30401b23c2 tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.812s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:59 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-2f149e6e-a244-4ac6-8b90-d5f53d470657 req-91ee6cd3-801f-4d7d-bc9b-1f30401b23c2 tempest-AttachVolumeTestJSON-419527975 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31', 'name': 'volume-407dcae8-f5e0-420e-9161-06e9d72d2cda', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2bbb387a-1a4e-4428-b196-cbe3e3e593a1', 'enforce_multipath': True} {{(pid=87359) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4975}} Jul 10 04:45:59 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-2f149e6e-a244-4ac6-8b90-d5f53d470657 req-91ee6cd3-801f-4d7d-bc9b-1f30401b23c2 tempest-AttachVolumeTestJSON-419527975 None] attachment_update completed successfully. Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Flow 'volume_create_manager' (9c3c6459-eb26-4409-acfb-6d9dcc7d3d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (946a8679-553d-486b-a734-67f6aad6f3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (946a8679-553d-486b-a734-67f6aad6f3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1603073685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d90b75-7e8e-403c-8d51-3d31ccf68f25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704c21a5d6a6464eb56d7f9c9cdf5ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:01Z,use_quota=True,user_id='741ffd3eea3c408a968731e2cc33cdac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d1871c-ba5a-4e04-96fe-6c497b8f56df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d1871c-ba5a-4e04-96fe-6c497b8f56df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9b982d-1c0b-4801-814f-c596af70cbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9b982d-1c0b-4801-814f-c596af70cbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97d90b75-7e8e-403c-8d51-3d31ccf68f25', 'volume_name': 'volume-97d90b75-7e8e-403c-8d51-3d31ccf68f25', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f255dc75-5dbc-4263-92c3-b2db9551f58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f255dc75-5dbc-4263-92c3-b2db9551f58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (638d217b-533c-4798-8459-cfe226f77aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:01 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Volume 97d90b75-7e8e-403c-8d51-3d31ccf68f25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97d90b75-7e8e-403c-8d51-3d31ccf68f25', 'volume_size': 1} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1603073685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d90b75-7e8e-403c-8d51-3d31ccf68f25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704c21a5d6a6464eb56d7f9c9cdf5ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:01Z,use_quota=True,user_id='741ffd3eea3c408a968731e2cc33cdac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Creating volume 97d90b75-7e8e-403c-8d51-3d31ccf68f25 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:46:01 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-97d90b75-7e8e-403c-8d51-3d31ccf68f25 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:01 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-97d90b75-7e8e-403c-8d51-3d31ccf68f25 1073741824 Jul 10 04:46:01 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Flow 'volume_create_manager' (5b1752a8-86e4-4d34-be62-38c10e16c44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12d05d2-554a-439b-b610-d18b5aebe0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12d05d2-554a-439b-b610-d18b5aebe0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1349377123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a93823-1435-4c3b-b0e1-ff58509db087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704c21a5d6a6464eb56d7f9c9cdf5ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:02Z,use_quota=True,user_id='741ffd3eea3c408a968731e2cc33cdac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41fee1c-3fe5-4c10-a13d-e3caa2c692f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41fee1c-3fe5-4c10-a13d-e3caa2c692f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86df62d2-731b-4930-8a51-4d9a70bde50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86df62d2-731b-4930-8a51-4d9a70bde50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2a93823-1435-4c3b-b0e1-ff58509db087', 'volume_name': 'volume-e2a93823-1435-4c3b-b0e1-ff58509db087', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2875791-ff52-4c2f-ae64-e5f6c2c70bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2875791-ff52-4c2f-ae64-e5f6c2c70bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c03a9c0-f0a3-4d98-a948-c3bc019e278a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:01 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Volume e2a93823-1435-4c3b-b0e1-ff58509db087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2a93823-1435-4c3b-b0e1-ff58509db087', 'volume_size': 1} Jul 10 04:46:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:02 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:46:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Flow 'volume_create_manager' (614d83df-05dd-440b-a322-0c159880b933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095c82ed-0558-44c9-a5f1-b23e83dd09ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095c82ed-0558-44c9-a5f1-b23e83dd09ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-853274102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98494d08-3a32-4749-a188-9c82c5440eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704c21a5d6a6464eb56d7f9c9cdf5ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:02Z,use_quota=True,user_id='741ffd3eea3c408a968731e2cc33cdac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c88f5cb-a64c-4c72-bedd-fec089f015e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c88f5cb-a64c-4c72-bedd-fec089f015e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2405c79f-5207-43f5-837b-dedfc8305a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2405c79f-5207-43f5-837b-dedfc8305a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98494d08-3a32-4749-a188-9c82c5440eff', 'volume_name': 'volume-98494d08-3a32-4749-a188-9c82c5440eff', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700dcb0e-c782-4274-85a5-ea4e1893816b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700dcb0e-c782-4274-85a5-ea4e1893816b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4f4d71-e5f0-4ae5-9b0c-e950b4505695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:02 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Volume 98494d08-3a32-4749-a188-9c82c5440eff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98494d08-3a32-4749-a188-9c82c5440eff', 'volume_size': 1} Jul 10 04:46:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:02 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-97d90b75-7e8e-403c-8d51-3d31ccf68f25 1073741824" returned: 0 in 1.165s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-97d90b75-7e8e-403c-8d51-3d31ccf68f25 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:02 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-97d90b75-7e8e-403c-8d51-3d31ccf68f25 Jul 10 04:46:02 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:02 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:46:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Flow 'volume_create_manager' (e513c367-f2a4-4d11-8d38-9221664efa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52a2fa0-6950-4b4e-b358-9bb3828e6884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52a2fa0-6950-4b4e-b358-9bb3828e6884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-507749944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726c204b-797b-4914-bac6-a0ec6a663073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704c21a5d6a6464eb56d7f9c9cdf5ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:03Z,use_quota=True,user_id='741ffd3eea3c408a968731e2cc33cdac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1544a616-fc36-4471-9992-517a59f74024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1544a616-fc36-4471-9992-517a59f74024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ff3998-e95a-442e-b5aa-140bf2881ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ff3998-e95a-442e-b5aa-140bf2881ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '726c204b-797b-4914-bac6-a0ec6a663073', 'volume_name': 'volume-726c204b-797b-4914-bac6-a0ec6a663073', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (910bfdd0-26e5-4d60-a4df-504853ac04c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (910bfdd0-26e5-4d60-a4df-504853ac04c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22538cb9-f2f1-4c26-b556-3bf1e85c2e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:03 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Volume 726c204b-797b-4914-bac6-a0ec6a663073: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-726c204b-797b-4914-bac6-a0ec6a663073', 'volume_size': 1} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Flow 'volume_create_manager' (5850186e-fbfc-4d28-bbf1-ad9ec3159a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0d27e7-52d7-408a-a5f6-1f980aa146c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0d27e7-52d7-408a-a5f6-1f980aa146c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-807130806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f04d87c-d159-43ea-b0e4-aec729aa153b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704c21a5d6a6464eb56d7f9c9cdf5ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:03Z,use_quota=True,user_id='741ffd3eea3c408a968731e2cc33cdac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb61967-1506-4533-9b36-244673f66235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb61967-1506-4533-9b36-244673f66235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db455e7-8aaf-4805-8858-8a1099f6bd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db455e7-8aaf-4805-8858-8a1099f6bd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f04d87c-d159-43ea-b0e4-aec729aa153b', 'volume_name': 'volume-5f04d87c-d159-43ea-b0e4-aec729aa153b', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef91a98-3612-4beb-920f-4bf858bb4583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef91a98-3612-4beb-920f-4bf858bb4583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d26b07-336a-4ab6-bdd0-c42a9d81419e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:03 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Volume 5f04d87c-d159-43ea-b0e4-aec729aa153b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f04d87c-d159-43ea-b0e4-aec729aa153b', 'volume_size': 1} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:03 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-97d90b75-7e8e-403c-8d51-3d31ccf68f25" returned: 0 in 0.972s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] <== create_volume: return (2197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.200s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.754s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1349377123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a93823-1435-4c3b-b0e1-ff58509db087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704c21a5d6a6464eb56d7f9c9cdf5ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:02Z,use_quota=True,user_id='741ffd3eea3c408a968731e2cc33cdac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Creating volume e2a93823-1435-4c3b-b0e1-ff58509db087 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:46:03 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2a93823-1435-4c3b-b0e1-ff58509db087 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (638d217b-533c-4798-8459-cfe226f77aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97d90b75-7e8e-403c-8d51-3d31ccf68f25', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f022fbf-46c1-42af-b168-c9b23fb8827b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:03 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2a93823-1435-4c3b-b0e1-ff58509db087 1073741824 Jul 10 04:46:03 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:03 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Volume volume-97d90b75-7e8e-403c-8d51-3d31ccf68f25 (97d90b75-7e8e-403c-8d51-3d31ccf68f25): created successfully Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f022fbf-46c1-42af-b168-c9b23fb8827b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Flow 'volume_create_manager' (9c3c6459-eb26-4409-acfb-6d9dcc7d3d2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:03 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-2e46c7a0-f9a3-4be7-a1f3-6d6b2d2666c0 tempest-CreateVolumesFromImageTest-93488392 None] Created volume successfully. Jul 10 04:46:04 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:46:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Flow 'volume_create_manager' (579ecb3f-0fe8-4181-97ac-82c7b89eb3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586c581e-70ff-495d-83e3-5476cdea3443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586c581e-70ff-495d-83e3-5476cdea3443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1574391371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e51f36d6-2afc-41e2-b7fd-0fbac96fec9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5e246d0421483a8b3dd2d6e7ec3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:04Z,use_quota=True,user_id='edae621172ca425b9b02983dc59c33fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a556ff46-f51c-4931-98ed-6e7e351bbc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a556ff46-f51c-4931-98ed-6e7e351bbc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (985fe955-37e2-4fd6-8a28-e8655f8253b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (985fe955-37e2-4fd6-8a28-e8655f8253b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e51f36d6-2afc-41e2-b7fd-0fbac96fec9c', 'volume_name': 'volume-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce916360-2156-43f4-8fd3-40a558e115c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce916360-2156-43f4-8fd3-40a558e115c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d58cc62-130c-49a2-94a6-fee358705432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:04 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Volume e51f36d6-2afc-41e2-b7fd-0fbac96fec9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c', 'volume_size': 1} Jul 10 04:46:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:04 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2a93823-1435-4c3b-b0e1-ff58509db087 1073741824" returned: 0 in 1.041s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2a93823-1435-4c3b-b0e1-ff58509db087 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:04 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2a93823-1435-4c3b-b0e1-ff58509db087 Jul 10 04:46:04 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:05 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2a93823-1435-4c3b-b0e1-ff58509db087" returned: 0 in 0.700s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:46:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.993s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-853274102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98494d08-3a32-4749-a188-9c82c5440eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704c21a5d6a6464eb56d7f9c9cdf5ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:02Z,use_quota=True,user_id='741ffd3eea3c408a968731e2cc33cdac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:46:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Creating volume 98494d08-3a32-4749-a188-9c82c5440eff {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:46:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:46:05 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:46:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-98494d08-3a32-4749-a188-9c82c5440eff 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:05 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-98494d08-3a32-4749-a188-9c82c5440eff 1073741824 Jul 10 04:46:05 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:05 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c03a9c0-f0a3-4d98-a948-c3bc019e278a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2a93823-1435-4c3b-b0e1-ff58509db087', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:05 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0769e1f4-ffd2-4cda-9315-2f3744be0125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:05 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Volume volume-e2a93823-1435-4c3b-b0e1-ff58509db087 (e2a93823-1435-4c3b-b0e1-ff58509db087): created successfully Jul 10 04:46:05 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0769e1f4-ffd2-4cda-9315-2f3744be0125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:05 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Flow 'volume_create_manager' (5b1752a8-86e4-4d34-be62-38c10e16c44c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:05 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-e800bcf4-afd4-4db5-9e59-8c511fe5b1b0 tempest-CreateVolumesFromImageTest-93488392 None] Created volume successfully. Jul 10 04:46:06 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-98494d08-3a32-4749-a188-9c82c5440eff 1073741824" returned: 0 in 0.850s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-98494d08-3a32-4749-a188-9c82c5440eff {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:06 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-98494d08-3a32-4749-a188-9c82c5440eff Jul 10 04:46:06 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:07 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-98494d08-3a32-4749-a188-9c82c5440eff" returned: 0 in 0.720s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:46:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.095s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-507749944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726c204b-797b-4914-bac6-a0ec6a663073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704c21a5d6a6464eb56d7f9c9cdf5ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:03Z,use_quota=True,user_id='741ffd3eea3c408a968731e2cc33cdac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:46:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Creating volume 726c204b-797b-4914-bac6-a0ec6a663073 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:46:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:46:07 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:46:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-726c204b-797b-4914-bac6-a0ec6a663073 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4f4d71-e5f0-4ae5-9b0c-e950b4505695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98494d08-3a32-4749-a188-9c82c5440eff', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:07 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-726c204b-797b-4914-bac6-a0ec6a663073 1073741824 Jul 10 04:46:07 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8efbf6fc-d50c-438e-9d17-777c06b48d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:07 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Volume volume-98494d08-3a32-4749-a188-9c82c5440eff (98494d08-3a32-4749-a188-9c82c5440eff): created successfully Jul 10 04:46:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8efbf6fc-d50c-438e-9d17-777c06b48d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Flow 'volume_create_manager' (614d83df-05dd-440b-a322-0c159880b933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:07 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-9dae5a57-ffae-484d-b3ce-bc6dfc9389df tempest-CreateVolumesFromImageTest-93488392 None] Created volume successfully. Jul 10 04:46:08 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-726c204b-797b-4914-bac6-a0ec6a663073 1073741824" returned: 0 in 0.941s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-726c204b-797b-4914-bac6-a0ec6a663073 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:08 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-726c204b-797b-4914-bac6-a0ec6a663073 Jul 10 04:46:08 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e3014f25-4011-4b7f-af4e-317b6db4d02a tempest-VolumesNegativeTest-1128226326 None] Acquiring lock "cinder-c7b320f1-b378-4b56-af9f-af4f5d7ed986-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e3014f25-4011-4b7f-af4e-317b6db4d02a tempest-VolumesNegativeTest-1128226326 None] Lock "cinder-c7b320f1-b378-4b56-af9f-af4f5d7ed986-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e3014f25-4011-4b7f-af4e-317b6db4d02a tempest-VolumesNegativeTest-1128226326 None] Acquiring lock "cinder-quobyte-c7b320f1-b378-4b56-af9f-af4f5d7ed986" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e3014f25-4011-4b7f-af4e-317b6db4d02a tempest-VolumesNegativeTest-1128226326 None] Lock "cinder-quobyte-c7b320f1-b378-4b56-af9f-af4f5d7ed986" acquired by "delete_volume" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d5d815-8a70-4cde-b076-a8c6653f2d1e]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e3014f25-4011-4b7f-af4e-317b6db4d02a tempest-VolumesNegativeTest-1128226326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c7b320f1-b378-4b56-af9f-af4f5d7ed986 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:08 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c7b320f1-b378-4b56-af9f-af4f5d7ed986 Jul 10 04:46:08 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:08 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-726c204b-797b-4914-bac6-a0ec6a663073" returned: 0 in 0.680s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.239s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-807130806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f04d87c-d159-43ea-b0e4-aec729aa153b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704c21a5d6a6464eb56d7f9c9cdf5ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:03Z,use_quota=True,user_id='741ffd3eea3c408a968731e2cc33cdac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Creating volume 5f04d87c-d159-43ea-b0e4-aec729aa153b {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:46:08 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5f04d87c-d159-43ea-b0e4-aec729aa153b 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:08 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5f04d87c-d159-43ea-b0e4-aec729aa153b 1073741824 Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22538cb9-f2f1-4c26-b556-3bf1e85c2e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-726c204b-797b-4914-bac6-a0ec6a663073', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:08 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a26969-0868-42f2-a5f5-baf3ec5c5d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:08 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Volume volume-726c204b-797b-4914-bac6-a0ec6a663073 (726c204b-797b-4914-bac6-a0ec6a663073): created successfully Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a26969-0868-42f2-a5f5-baf3ec5c5d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Flow 'volume_create_manager' (e513c367-f2a4-4d11-8d38-9221664efa2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:08 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-9bd9e110-a635-4060-8b83-6879108e89f4 tempest-CreateVolumesFromImageTest-93488392 None] Created volume successfully. Jul 10 04:46:09 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e3014f25-4011-4b7f-af4e-317b6db4d02a tempest-VolumesNegativeTest-1128226326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c7b320f1-b378-4b56-af9f-af4f5d7ed986" returned: 0 in 0.802s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e3014f25-4011-4b7f-af4e-317b6db4d02a tempest-VolumesNegativeTest-1128226326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c7b320f1-b378-4b56-af9f-af4f5d7ed986 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:09 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c7b320f1-b378-4b56-af9f-af4f5d7ed986 Jul 10 04:46:09 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:09 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5f04d87c-d159-43ea-b0e4-aec729aa153b 1073741824" returned: 0 in 0.860s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5f04d87c-d159-43ea-b0e4-aec729aa153b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:09 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5f04d87c-d159-43ea-b0e4-aec729aa153b Jul 10 04:46:09 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:09 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e3014f25-4011-4b7f-af4e-317b6db4d02a tempest-VolumesNegativeTest-1128226326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c7b320f1-b378-4b56-af9f-af4f5d7ed986" returned: 0 in 0.700s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:09 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e3014f25-4011-4b7f-af4e-317b6db4d02a tempest-VolumesNegativeTest-1128226326 None] Lock "cinder-quobyte-c7b320f1-b378-4b56-af9f-af4f5d7ed986" released by "delete_volume" :: held 1.557s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:09 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-e3014f25-4011-4b7f-af4e-317b6db4d02a tempest-VolumesNegativeTest-1128226326 None] Created reservations ['8bccbb7e-8c7a-4512-ac7c-197e1d532cbd', 'ab322639-af0d-4cc1-b3f4-cbb6492a4175', 'f2a98b04-42ed-4df1-adb3-276baf56652c', '9d11a4e4-0225-4c52-b37a-fda69696cb94'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e3014f25-4011-4b7f-af4e-317b6db4d02a tempest-VolumesNegativeTest-1128226326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e3014f25-4011-4b7f-af4e-317b6db4d02a tempest-VolumesNegativeTest-1128226326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e3014f25-4011-4b7f-af4e-317b6db4d02a tempest-VolumesNegativeTest-1128226326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e3014f25-4011-4b7f-af4e-317b6db4d02a tempest-VolumesNegativeTest-1128226326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e3014f25-4011-4b7f-af4e-317b6db4d02a tempest-VolumesNegativeTest-1128226326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e3014f25-4011-4b7f-af4e-317b6db4d02a tempest-VolumesNegativeTest-1128226326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:10 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:46:10 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:10 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5f04d87c-d159-43ea-b0e4-aec729aa153b" returned: 0 in 0.632s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.047s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1574391371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e51f36d6-2afc-41e2-b7fd-0fbac96fec9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5e246d0421483a8b3dd2d6e7ec3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:04Z,use_quota=True,user_id='edae621172ca425b9b02983dc59c33fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Creating volume e51f36d6-2afc-41e2-b7fd-0fbac96fec9c {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:46:10 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d26b07-336a-4ab6-bdd0-c42a9d81419e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f04d87c-d159-43ea-b0e4-aec729aa153b', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:10 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c 1073741824 Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70799666-249e-425e-b6f1-480c3a6ea38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:10 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:10 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Volume volume-5f04d87c-d159-43ea-b0e4-aec729aa153b (5f04d87c-d159-43ea-b0e4-aec729aa153b): created successfully Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70799666-249e-425e-b6f1-480c3a6ea38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Flow 'volume_create_manager' (5850186e-fbfc-4d28-bbf1-ad9ec3159a7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:10 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-bfe5ccb2-0482-43cb-bfa2-a1faa132b08e tempest-CreateVolumesFromImageTest-93488392 None] Created volume successfully. Jul 10 04:46:10 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e3014f25-4011-4b7f-af4e-317b6db4d02a tempest-VolumesNegativeTest-1128226326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.732s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-e3014f25-4011-4b7f-af4e-317b6db4d02a tempest-VolumesNegativeTest-1128226326 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:10 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-e3014f25-4011-4b7f-af4e-317b6db4d02a tempest-VolumesNegativeTest-1128226326 None] Deleted volume successfully. Jul 10 04:46:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e3014f25-4011-4b7f-af4e-317b6db4d02a tempest-VolumesNegativeTest-1128226326 None] Lock "cinder-c7b320f1-b378-4b56-af9f-af4f5d7ed986-delete_volume" released by "delete_volume" :: held 2.541s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:11 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2ce5a89c-2022-4a66-846e-3986250d4dc5 tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "cinder-5f04d87c-d159-43ea-b0e4-aec729aa153b-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:11 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2ce5a89c-2022-4a66-846e-3986250d4dc5 tempest-CreateVolumesFromImageTest-93488392 None] Lock "cinder-5f04d87c-d159-43ea-b0e4-aec729aa153b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:11 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2ce5a89c-2022-4a66-846e-3986250d4dc5 tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "cinder-quobyte-5f04d87c-d159-43ea-b0e4-aec729aa153b" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:11 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2ce5a89c-2022-4a66-846e-3986250d4dc5 tempest-CreateVolumesFromImageTest-93488392 None] Lock "cinder-quobyte-5f04d87c-d159-43ea-b0e4-aec729aa153b" acquired by "delete_volume" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:11 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[695ce25c-3b97-4fad-9503-68e7f9d4737d]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2ce5a89c-2022-4a66-846e-3986250d4dc5 tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5f04d87c-d159-43ea-b0e4-aec729aa153b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:11 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:11 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5f04d87c-d159-43ea-b0e4-aec729aa153b Jul 10 04:46:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c 1073741824" returned: 0 in 0.961s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:11 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:11 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c Jul 10 04:46:11 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:12 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2ce5a89c-2022-4a66-846e-3986250d4dc5 tempest-CreateVolumesFromImageTest-93488392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5f04d87c-d159-43ea-b0e4-aec729aa153b" returned: 0 in 0.873s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2ce5a89c-2022-4a66-846e-3986250d4dc5 tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5f04d87c-d159-43ea-b0e4-aec729aa153b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:12 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c" returned: 0 in 0.743s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:46:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:12 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5f04d87c-d159-43ea-b0e4-aec729aa153b Jul 10 04:46:12 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d58cc62-130c-49a2-94a6-fee358705432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24792429-6f6d-4bd4-b4fc-b48b02bff874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:12 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Volume volume-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c (e51f36d6-2afc-41e2-b7fd-0fbac96fec9c): created successfully Jul 10 04:46:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24792429-6f6d-4bd4-b4fc-b48b02bff874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Flow 'volume_create_manager' (579ecb3f-0fe8-4181-97ac-82c7b89eb3b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:12 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d83381e7-92c7-48fa-865a-6aa8e1103ace tempest-AttachVolumeTestJSON-419527975 None] Created volume successfully. Jul 10 04:46:12 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2ce5a89c-2022-4a66-846e-3986250d4dc5 tempest-CreateVolumesFromImageTest-93488392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5f04d87c-d159-43ea-b0e4-aec729aa153b" returned: 0 in 0.697s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:12 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2ce5a89c-2022-4a66-846e-3986250d4dc5 tempest-CreateVolumesFromImageTest-93488392 None] Lock "cinder-quobyte-5f04d87c-d159-43ea-b0e4-aec729aa153b" released by "delete_volume" :: held 1.623s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:12 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-2ce5a89c-2022-4a66-846e-3986250d4dc5 tempest-CreateVolumesFromImageTest-93488392 None] Created reservations ['3936c155-73f0-4194-93e0-a93f38f66010', 'cbf7d3cb-1d16-40ec-8b9c-d7e643d49567', 'f6a380a1-2db5-4276-ac6d-5db3da36383d', '083084ca-243b-4c17-ad56-e3467a83f774'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:46:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2ce5a89c-2022-4a66-846e-3986250d4dc5 tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2ce5a89c-2022-4a66-846e-3986250d4dc5 tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2ce5a89c-2022-4a66-846e-3986250d4dc5 tempest-CreateVolumesFromImageTest-93488392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2ce5a89c-2022-4a66-846e-3986250d4dc5 tempest-CreateVolumesFromImageTest-93488392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2ce5a89c-2022-4a66-846e-3986250d4dc5 tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2ce5a89c-2022-4a66-846e-3986250d4dc5 tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:12 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:46:12 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3ca324b2-046b-42cf-b337-88fa801f9a95 tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "cinder-726c204b-797b-4914-bac6-a0ec6a663073-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3ca324b2-046b-42cf-b337-88fa801f9a95 tempest-CreateVolumesFromImageTest-93488392 None] Lock "cinder-726c204b-797b-4914-bac6-a0ec6a663073-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3ca324b2-046b-42cf-b337-88fa801f9a95 tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "cinder-quobyte-726c204b-797b-4914-bac6-a0ec6a663073" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3ca324b2-046b-42cf-b337-88fa801f9a95 tempest-CreateVolumesFromImageTest-93488392 None] Lock "cinder-quobyte-726c204b-797b-4914-bac6-a0ec6a663073" acquired by "delete_volume" :: waited 0.027s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:13 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1c384d-634d-4cbe-9010-4c1178991769]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3ca324b2-046b-42cf-b337-88fa801f9a95 tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-726c204b-797b-4914-bac6-a0ec6a663073 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:13 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-726c204b-797b-4914-bac6-a0ec6a663073 Jul 10 04:46:13 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:13 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2ce5a89c-2022-4a66-846e-3986250d4dc5 tempest-CreateVolumesFromImageTest-93488392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.727s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:13 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-2ce5a89c-2022-4a66-846e-3986250d4dc5 tempest-CreateVolumesFromImageTest-93488392 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:13 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-2ce5a89c-2022-4a66-846e-3986250d4dc5 tempest-CreateVolumesFromImageTest-93488392 None] Deleted volume successfully. Jul 10 04:46:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2ce5a89c-2022-4a66-846e-3986250d4dc5 tempest-CreateVolumesFromImageTest-93488392 None] Lock "cinder-5f04d87c-d159-43ea-b0e4-aec729aa153b-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:14 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3ca324b2-046b-42cf-b337-88fa801f9a95 tempest-CreateVolumesFromImageTest-93488392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-726c204b-797b-4914-bac6-a0ec6a663073" returned: 0 in 0.854s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3ca324b2-046b-42cf-b337-88fa801f9a95 tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-726c204b-797b-4914-bac6-a0ec6a663073 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:14 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-726c204b-797b-4914-bac6-a0ec6a663073 Jul 10 04:46:14 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:15 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3ca324b2-046b-42cf-b337-88fa801f9a95 tempest-CreateVolumesFromImageTest-93488392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-726c204b-797b-4914-bac6-a0ec6a663073" returned: 0 in 0.708s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3ca324b2-046b-42cf-b337-88fa801f9a95 tempest-CreateVolumesFromImageTest-93488392 None] Lock "cinder-quobyte-726c204b-797b-4914-bac6-a0ec6a663073" released by "delete_volume" :: held 1.609s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-3ca324b2-046b-42cf-b337-88fa801f9a95 tempest-CreateVolumesFromImageTest-93488392 None] Created reservations ['86e9046b-9a6e-48e8-bbef-73de853dd6a3', 'b87363e7-7a70-4030-8651-a5b04b83c691', '89283955-217d-4584-b77f-c324ddf6789d', '35062a94-ba8a-4d96-b8d8-a1237a7b2920'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3ca324b2-046b-42cf-b337-88fa801f9a95 tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3ca324b2-046b-42cf-b337-88fa801f9a95 tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3ca324b2-046b-42cf-b337-88fa801f9a95 tempest-CreateVolumesFromImageTest-93488392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3ca324b2-046b-42cf-b337-88fa801f9a95 tempest-CreateVolumesFromImageTest-93488392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3ca324b2-046b-42cf-b337-88fa801f9a95 tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3ca324b2-046b-42cf-b337-88fa801f9a95 tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:15 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:46:15 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d0b06d84-bd10-4f0e-ab74-96674837d6c5 tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "cinder-98494d08-3a32-4749-a188-9c82c5440eff-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d0b06d84-bd10-4f0e-ab74-96674837d6c5 tempest-CreateVolumesFromImageTest-93488392 None] Lock "cinder-98494d08-3a32-4749-a188-9c82c5440eff-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d0b06d84-bd10-4f0e-ab74-96674837d6c5 tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "cinder-quobyte-98494d08-3a32-4749-a188-9c82c5440eff" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d0b06d84-bd10-4f0e-ab74-96674837d6c5 tempest-CreateVolumesFromImageTest-93488392 None] Lock "cinder-quobyte-98494d08-3a32-4749-a188-9c82c5440eff" acquired by "delete_volume" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fe20cc-ab1a-4a79-99c9-213f321c5a06]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0b06d84-bd10-4f0e-ab74-96674837d6c5 tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-98494d08-3a32-4749-a188-9c82c5440eff {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:15 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-98494d08-3a32-4749-a188-9c82c5440eff Jul 10 04:46:15 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-59d984ed-0f2d-4451-84e0-9f32c6fe5b6b req-0f017f6b-2586-4e0a-a6f8-2538c3dd929b tempest-AttachVolumeTestJSON-419527975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-59d984ed-0f2d-4451-84e0-9f32c6fe5b6b req-0f017f6b-2586-4e0a-a6f8-2538c3dd929b tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:15 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:46:15 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:15 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[8870e0e4-e445-42d7-afb3-a6d4dde7a397]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-59d984ed-0f2d-4451-84e0-9f32c6fe5b6b req-0f017f6b-2586-4e0a-a6f8-2538c3dd929b tempest-AttachVolumeTestJSON-419527975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3ca324b2-046b-42cf-b337-88fa801f9a95 tempest-CreateVolumesFromImageTest-93488392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.783s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:15 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-3ca324b2-046b-42cf-b337-88fa801f9a95 tempest-CreateVolumesFromImageTest-93488392 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:16 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-3ca324b2-046b-42cf-b337-88fa801f9a95 tempest-CreateVolumesFromImageTest-93488392 None] Deleted volume successfully. Jul 10 04:46:16 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3ca324b2-046b-42cf-b337-88fa801f9a95 tempest-CreateVolumesFromImageTest-93488392 None] Lock "cinder-726c204b-797b-4914-bac6-a0ec6a663073-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:16 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c Jul 10 04:46:16 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:16 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0b06d84-bd10-4f0e-ab74-96674837d6c5 tempest-CreateVolumesFromImageTest-93488392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-98494d08-3a32-4749-a188-9c82c5440eff" returned: 0 in 0.944s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0b06d84-bd10-4f0e-ab74-96674837d6c5 tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-98494d08-3a32-4749-a188-9c82c5440eff {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:16 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-98494d08-3a32-4749-a188-9c82c5440eff Jul 10 04:46:16 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:16 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.978s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:16 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:46:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:46:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:46:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-59d984ed-0f2d-4451-84e0-9f32c6fe5b6b req-0f017f6b-2586-4e0a-a6f8-2538c3dd929b tempest-AttachVolumeTestJSON-419527975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c" returned: 0 in 0.925s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-59d984ed-0f2d-4451-84e0-9f32c6fe5b6b req-0f017f6b-2586-4e0a-a6f8-2538c3dd929b tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.961s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-59d984ed-0f2d-4451-84e0-9f32c6fe5b6b req-0f017f6b-2586-4e0a-a6f8-2538c3dd929b tempest-AttachVolumeTestJSON-419527975 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31', 'name': 'volume-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aacddf5b-9877-4a0d-9306-a1ac727a91f2', 'enforce_multipath': True} {{(pid=87359) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4975}} Jul 10 04:46:16 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-59d984ed-0f2d-4451-84e0-9f32c6fe5b6b req-0f017f6b-2586-4e0a-a6f8-2538c3dd929b tempest-AttachVolumeTestJSON-419527975 None] attachment_update completed successfully. Jul 10 04:46:17 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0b06d84-bd10-4f0e-ab74-96674837d6c5 tempest-CreateVolumesFromImageTest-93488392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-98494d08-3a32-4749-a188-9c82c5440eff" returned: 0 in 0.837s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:17 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d0b06d84-bd10-4f0e-ab74-96674837d6c5 tempest-CreateVolumesFromImageTest-93488392 None] Lock "cinder-quobyte-98494d08-3a32-4749-a188-9c82c5440eff" released by "delete_volume" :: held 1.849s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:17 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-d0b06d84-bd10-4f0e-ab74-96674837d6c5 tempest-CreateVolumesFromImageTest-93488392 None] Created reservations ['421a91b7-1242-49ba-bf81-1bdd8bf4c100', '46af1c5b-bff5-4507-bd05-1b306d552e09', '763f7103-ae8e-4511-baaf-d908b9fcd111', '034ab21e-6e45-4fb5-b5bb-aef0efb6cb83'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:46:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d0b06d84-bd10-4f0e-ab74-96674837d6c5 tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d0b06d84-bd10-4f0e-ab74-96674837d6c5 tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d0b06d84-bd10-4f0e-ab74-96674837d6c5 tempest-CreateVolumesFromImageTest-93488392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d0b06d84-bd10-4f0e-ab74-96674837d6c5 tempest-CreateVolumesFromImageTest-93488392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d0b06d84-bd10-4f0e-ab74-96674837d6c5 tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0b06d84-bd10-4f0e-ab74-96674837d6c5 tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:17 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:46:17 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:17 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9a02e69f-3acf-44a5-95fd-e3ffa401716c tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "cinder-e2a93823-1435-4c3b-b0e1-ff58509db087-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:17 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9a02e69f-3acf-44a5-95fd-e3ffa401716c tempest-CreateVolumesFromImageTest-93488392 None] Lock "cinder-e2a93823-1435-4c3b-b0e1-ff58509db087-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:17 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9a02e69f-3acf-44a5-95fd-e3ffa401716c tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "cinder-quobyte-e2a93823-1435-4c3b-b0e1-ff58509db087" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9a02e69f-3acf-44a5-95fd-e3ffa401716c tempest-CreateVolumesFromImageTest-93488392 None] Lock "cinder-quobyte-e2a93823-1435-4c3b-b0e1-ff58509db087" acquired by "delete_volume" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:18 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84f713d-cb15-43a4-9ab0-8ed5a50a4f1d]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9a02e69f-3acf-44a5-95fd-e3ffa401716c tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2a93823-1435-4c3b-b0e1-ff58509db087 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:18 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2a93823-1435-4c3b-b0e1-ff58509db087 Jul 10 04:46:18 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:18 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0b06d84-bd10-4f0e-ab74-96674837d6c5 tempest-CreateVolumesFromImageTest-93488392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.704s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:18 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-d0b06d84-bd10-4f0e-ab74-96674837d6c5 tempest-CreateVolumesFromImageTest-93488392 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:18 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d0b06d84-bd10-4f0e-ab74-96674837d6c5 tempest-CreateVolumesFromImageTest-93488392 None] Deleted volume successfully. Jul 10 04:46:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d0b06d84-bd10-4f0e-ab74-96674837d6c5 tempest-CreateVolumesFromImageTest-93488392 None] Lock "cinder-98494d08-3a32-4749-a188-9c82c5440eff-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:18 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9a02e69f-3acf-44a5-95fd-e3ffa401716c tempest-CreateVolumesFromImageTest-93488392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2a93823-1435-4c3b-b0e1-ff58509db087" returned: 0 in 0.855s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9a02e69f-3acf-44a5-95fd-e3ffa401716c tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2a93823-1435-4c3b-b0e1-ff58509db087 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:18 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2a93823-1435-4c3b-b0e1-ff58509db087 Jul 10 04:46:18 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:19 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9a02e69f-3acf-44a5-95fd-e3ffa401716c tempest-CreateVolumesFromImageTest-93488392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e2a93823-1435-4c3b-b0e1-ff58509db087" returned: 0 in 0.651s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9a02e69f-3acf-44a5-95fd-e3ffa401716c tempest-CreateVolumesFromImageTest-93488392 None] Lock "cinder-quobyte-e2a93823-1435-4c3b-b0e1-ff58509db087" released by "delete_volume" :: held 1.544s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:19 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-9a02e69f-3acf-44a5-95fd-e3ffa401716c tempest-CreateVolumesFromImageTest-93488392 None] Created reservations ['67fa7fb0-97eb-4b95-aa0b-c546f8d8f7db', '0b0272f3-e66f-46c9-b7d1-30b41d8af886', 'dcc23d11-ea21-4c89-9274-bbe4dd990e71', '30dab907-4400-4baa-a848-c653d3d04738'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:46:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9a02e69f-3acf-44a5-95fd-e3ffa401716c tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9a02e69f-3acf-44a5-95fd-e3ffa401716c tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9a02e69f-3acf-44a5-95fd-e3ffa401716c tempest-CreateVolumesFromImageTest-93488392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9a02e69f-3acf-44a5-95fd-e3ffa401716c tempest-CreateVolumesFromImageTest-93488392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9a02e69f-3acf-44a5-95fd-e3ffa401716c tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9a02e69f-3acf-44a5-95fd-e3ffa401716c tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:19 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:46:19 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:20 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5c680b09-7a55-4265-a3d1-1b2ab78abfbe tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "cinder-97d90b75-7e8e-403c-8d51-3d31ccf68f25-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:20 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5c680b09-7a55-4265-a3d1-1b2ab78abfbe tempest-CreateVolumesFromImageTest-93488392 None] Lock "cinder-97d90b75-7e8e-403c-8d51-3d31ccf68f25-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:20 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5c680b09-7a55-4265-a3d1-1b2ab78abfbe tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "cinder-quobyte-97d90b75-7e8e-403c-8d51-3d31ccf68f25" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:20 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5c680b09-7a55-4265-a3d1-1b2ab78abfbe tempest-CreateVolumesFromImageTest-93488392 None] Lock "cinder-quobyte-97d90b75-7e8e-403c-8d51-3d31ccf68f25" acquired by "delete_volume" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:20 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead18de8-a57f-4772-b965-426e447a3816]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5c680b09-7a55-4265-a3d1-1b2ab78abfbe tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-97d90b75-7e8e-403c-8d51-3d31ccf68f25 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:20 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9a02e69f-3acf-44a5-95fd-e3ffa401716c tempest-CreateVolumesFromImageTest-93488392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.709s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:20 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-9a02e69f-3acf-44a5-95fd-e3ffa401716c tempest-CreateVolumesFromImageTest-93488392 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:20 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-9a02e69f-3acf-44a5-95fd-e3ffa401716c tempest-CreateVolumesFromImageTest-93488392 None] Deleted volume successfully. Jul 10 04:46:20 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-97d90b75-7e8e-403c-8d51-3d31ccf68f25 Jul 10 04:46:20 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:20 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9a02e69f-3acf-44a5-95fd-e3ffa401716c tempest-CreateVolumesFromImageTest-93488392 None] Lock "cinder-e2a93823-1435-4c3b-b0e1-ff58509db087-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:21 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5c680b09-7a55-4265-a3d1-1b2ab78abfbe tempest-CreateVolumesFromImageTest-93488392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-97d90b75-7e8e-403c-8d51-3d31ccf68f25" returned: 0 in 0.863s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5c680b09-7a55-4265-a3d1-1b2ab78abfbe tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-97d90b75-7e8e-403c-8d51-3d31ccf68f25 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:21 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-97d90b75-7e8e-403c-8d51-3d31ccf68f25 Jul 10 04:46:21 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:21 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5c680b09-7a55-4265-a3d1-1b2ab78abfbe tempest-CreateVolumesFromImageTest-93488392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-97d90b75-7e8e-403c-8d51-3d31ccf68f25" returned: 0 in 0.729s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:21 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5c680b09-7a55-4265-a3d1-1b2ab78abfbe tempest-CreateVolumesFromImageTest-93488392 None] Lock "cinder-quobyte-97d90b75-7e8e-403c-8d51-3d31ccf68f25" released by "delete_volume" :: held 1.664s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:21 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-5c680b09-7a55-4265-a3d1-1b2ab78abfbe tempest-CreateVolumesFromImageTest-93488392 None] Created reservations ['db2739b9-ef44-420a-b03d-bd5aa5015413', '95d08ae0-43dd-4343-9b91-c4ffab73770f', '272e4d1a-bcf4-4d25-8006-83fb5785f7d4', '14b327aa-5dfe-463a-813b-7c26fa5174dc'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:46:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5c680b09-7a55-4265-a3d1-1b2ab78abfbe tempest-CreateVolumesFromImageTest-93488392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5c680b09-7a55-4265-a3d1-1b2ab78abfbe tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5c680b09-7a55-4265-a3d1-1b2ab78abfbe tempest-CreateVolumesFromImageTest-93488392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5c680b09-7a55-4265-a3d1-1b2ab78abfbe tempest-CreateVolumesFromImageTest-93488392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5c680b09-7a55-4265-a3d1-1b2ab78abfbe tempest-CreateVolumesFromImageTest-93488392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5c680b09-7a55-4265-a3d1-1b2ab78abfbe tempest-CreateVolumesFromImageTest-93488392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:22 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:46:22 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:22 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-91732945-b125-4aee-8a91-54c51d8f5e20 req-a793f223-e6f2-4f42-9c8a-ed0eff68fd97 tempest-AttachVolumeTestJSON-419527975 None] Terminate volume connection completed successfully. Jul 10 04:46:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-91732945-b125-4aee-8a91-54c51d8f5e20 req-a793f223-e6f2-4f42-9c8a-ed0eff68fd97 tempest-AttachVolumeTestJSON-419527975 None] Deleting attachment 2bbb387a-1a4e-4428-b196-cbe3e3e593a1. {{(pid=87359) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5106}} Jul 10 04:46:23 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5c680b09-7a55-4265-a3d1-1b2ab78abfbe tempest-CreateVolumesFromImageTest-93488392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.928s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:23 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-5c680b09-7a55-4265-a3d1-1b2ab78abfbe tempest-CreateVolumesFromImageTest-93488392 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:23 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-5c680b09-7a55-4265-a3d1-1b2ab78abfbe tempest-CreateVolumesFromImageTest-93488392 None] Deleted volume successfully. Jul 10 04:46:23 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5c680b09-7a55-4265-a3d1-1b2ab78abfbe tempest-CreateVolumesFromImageTest-93488392 None] Lock "cinder-97d90b75-7e8e-403c-8d51-3d31ccf68f25-delete_volume" released by "delete_volume" :: held 2.900s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:25 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-30de2ab6-85bc-480d-8b21-4e8909c0bb8c req-f516be16-282a-467e-b7ad-283a5a358ab6 tempest-AttachVolumeTestJSON-419527975 None] Terminate volume connection completed successfully. Jul 10 04:46:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-30de2ab6-85bc-480d-8b21-4e8909c0bb8c req-f516be16-282a-467e-b7ad-283a5a358ab6 tempest-AttachVolumeTestJSON-419527975 None] Deleting attachment aacddf5b-9877-4a0d-9306-a1ac727a91f2. {{(pid=87359) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5106}} Jul 10 04:46:25 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:46:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Flow 'volume_create_manager' (8120a104-782b-4c1a-8fd4-3191564a4b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b62d06-afc8-47a3-9476-41d8fa6010e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b62d06-afc8-47a3-9476-41d8fa6010e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-461424508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32a74b1457b45d9928e7435f402ab76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:26Z,use_quota=True,user_id='94c1cf1a986841fcb8dc0667973e4553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00b1f9e-ec79-4521-b90c-cee8c3b1a332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00b1f9e-ec79-4521-b90c-cee8c3b1a332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ab45ed-016e-4b47-8336-978639697940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ab45ed-016e-4b47-8336-978639697940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6', 'volume_name': 'volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38ff450-edad-4bb8-832b-3ccc79e9c22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38ff450-edad-4bb8-832b-3ccc79e9c22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ccb3675-816b-4c62-a154-2a699fb6eec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:26 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Volume a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6', 'volume_size': 1} Jul 10 04:46:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-461424508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32a74b1457b45d9928e7435f402ab76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:26Z,use_quota=True,user_id='94c1cf1a986841fcb8dc0667973e4553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:46:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Creating volume a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:46:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:46:26 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:46:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:26 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6 1073741824 Jul 10 04:46:26 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:26 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6 1073741824" returned: 0 in 0.873s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:26 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6 Jul 10 04:46:26 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:27 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6" returned: 0 in 0.715s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:46:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ccb3675-816b-4c62-a154-2a699fb6eec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45d6f842-bb03-4d6e-8e30-87bc44800396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:27 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Volume volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6 (a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6): created successfully Jul 10 04:46:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45d6f842-bb03-4d6e-8e30-87bc44800396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Flow 'volume_create_manager' (8120a104-782b-4c1a-8fd4-3191564a4b79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:27 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-8348aa74-f162-4c5a-946b-da2f30e91d42 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Created volume successfully. Jul 10 04:46:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-20aaed94-2f63-4581-9122-b8412711378e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-20aaed94-2f63-4581-9122-b8412711378e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-20aaed94-2f63-4581-9122-b8412711378e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Creating offline snapshot 5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4 of volume a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:46:28 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9fcb32-aa44-4ac5-9246-51126c5e142a]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-20aaed94-2f63-4581-9122-b8412711378e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:28 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6 Jul 10 04:46:28 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:29 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-20aaed94-2f63-4581-9122-b8412711378e tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6" returned: 0 in 0.937s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-20aaed94-2f63-4581-9122-b8412711378e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:29 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4 1G Jul 10 04:46:29 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:30 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-20aaed94-2f63-4581-9122-b8412711378e tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4 1G" returned: 0 in 1.171s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-20aaed94-2f63-4581-9122-b8412711378e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:30 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4 Jul 10 04:46:30 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:31 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-20aaed94-2f63-4581-9122-b8412711378e tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4" returned: 0 in 0.771s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:31 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-20aaed94-2f63-4581-9122-b8412711378e tempest-CreateVolumesFromSnapshotTest-2089144724 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4 is being set with open permissions: ugo+rw Jul 10 04:46:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-20aaed94-2f63-4581-9122-b8412711378e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:31 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4 Jul 10 04:46:31 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:32 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-20aaed94-2f63-4581-9122-b8412711378e tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4" returned: 0 in 0.837s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-20aaed94-2f63-4581-9122-b8412711378e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:32 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.info Jul 10 04:46:32 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:32 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-20aaed94-2f63-4581-9122-b8412711378e tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.info" returned: 0 in 0.858s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:32 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-20aaed94-2f63-4581-9122-b8412711378e tempest-CreateVolumesFromSnapshotTest-2089144724 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.info is being set with open permissions: ugo+rw Jul 10 04:46:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-20aaed94-2f63-4581-9122-b8412711378e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:32 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.info Jul 10 04:46:32 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:33 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-20aaed94-2f63-4581-9122-b8412711378e tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.info" returned: 0 in 0.779s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-20aaed94-2f63-4581-9122-b8412711378e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.532s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:33 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-20aaed94-2f63-4581-9122-b8412711378e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Create snapshot completed successfully Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Flow 'volume_create_manager' (5ab81689-e35a-429c-8af3-cbde4c1d504f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667dfd2c-93b3-4a7b-af57-b8e4bfa8fb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667dfd2c-93b3-4a7b-af57-b8e4bfa8fb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1650716535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db0d535-3bfc-418b-82db-596493f3b31b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32a74b1457b45d9928e7435f402ab76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:35Z,use_quota=True,user_id='94c1cf1a986841fcb8dc0667973e4553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23845d1c-471e-4e60-b1b1-6b89a1dce5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23845d1c-471e-4e60-b1b1-6b89a1dce5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6990aa42-c469-490b-a885-7b2c638c7e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6990aa42-c469-490b-a885-7b2c638c7e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0db0d535-3bfc-418b-82db-596493f3b31b', 'volume_name': 'volume-0db0d535-3bfc-418b-82db-596493f3b31b', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e902f7fb-a4d6-40aa-b85d-4ad7354e4c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e902f7fb-a4d6-40aa-b85d-4ad7354e4c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db6d5df-19f9-4911-8b24-cea7852e4d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:35 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Volume 0db0d535-3bfc-418b-82db-596493f3b31b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0db0d535-3bfc-418b-82db-596493f3b31b', 'volume_size': 1} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1650716535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db0d535-3bfc-418b-82db-596493f3b31b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32a74b1457b45d9928e7435f402ab76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:35Z,use_quota=True,user_id='94c1cf1a986841fcb8dc0667973e4553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Creating volume 0db0d535-3bfc-418b-82db-596493f3b31b {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:46:35 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0db0d535-3bfc-418b-82db-596493f3b31b 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:35 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0db0d535-3bfc-418b-82db-596493f3b31b 1073741824 Jul 10 04:46:35 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Flow 'volume_create_manager' (4ea09245-bc30-4672-a579-b59b45ee23f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a530599d-7668-48d5-a23c-af4eb638e475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a530599d-7668-48d5-a23c-af4eb638e475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1294955570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5220db1-1e41-4ada-8b99-b0298b5f6f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32a74b1457b45d9928e7435f402ab76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:35Z,use_quota=True,user_id='94c1cf1a986841fcb8dc0667973e4553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6141071a-8fee-4b24-b01b-4d09d0845718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6141071a-8fee-4b24-b01b-4d09d0845718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11520206-fd80-468b-b995-5b0b5cc79a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11520206-fd80-468b-b995-5b0b5cc79a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5220db1-1e41-4ada-8b99-b0298b5f6f7b', 'volume_name': 'volume-a5220db1-1e41-4ada-8b99-b0298b5f6f7b', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672ffba6-4677-4c43-afed-e311cc0970f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672ffba6-4677-4c43-afed-e311cc0970f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef89842f-b25f-4920-899a-511405cac500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:35 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Volume a5220db1-1e41-4ada-8b99-b0298b5f6f7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5220db1-1e41-4ada-8b99-b0298b5f6f7b', 'volume_size': 1} Jul 10 04:46:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Flow 'volume_create_manager' (69d60c2c-6790-425c-ba37-e03cad1fc2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb2ce79c-95e2-4ff7-948b-87b82269a966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb2ce79c-95e2-4ff7-948b-87b82269a966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1583821754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cedfdbbe-c2a2-4187-868a-19dacc7e6565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32a74b1457b45d9928e7435f402ab76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:36Z,use_quota=True,user_id='94c1cf1a986841fcb8dc0667973e4553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ad52cf-131c-4ce3-b427-d10ca1a51ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ad52cf-131c-4ce3-b427-d10ca1a51ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98dcba1e-bfd8-42bd-9b25-1dc888aefb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98dcba1e-bfd8-42bd-9b25-1dc888aefb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cedfdbbe-c2a2-4187-868a-19dacc7e6565', 'volume_name': 'volume-cedfdbbe-c2a2-4187-868a-19dacc7e6565', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b882c5-52ff-41a3-a22c-f5a2844ecf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b882c5-52ff-41a3-a22c-f5a2844ecf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45922736-5df2-43f8-9e13-b69774aed12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:36 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Volume cedfdbbe-c2a2-4187-868a-19dacc7e6565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cedfdbbe-c2a2-4187-868a-19dacc7e6565', 'volume_size': 1} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:36 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0db0d535-3bfc-418b-82db-596493f3b31b 1073741824" returned: 0 in 1.181s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0db0d535-3bfc-418b-82db-596493f3b31b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:36 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0db0d535-3bfc-418b-82db-596493f3b31b Jul 10 04:46:36 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Flow 'volume_create_manager' (6368ce1b-f5ff-44ce-b90f-0dde39b43c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49424399-2aee-4885-a26d-ed7ad0dad78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49424399-2aee-4885-a26d-ed7ad0dad78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1541718831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f95a4c36-67db-4d47-a8aa-28e535edd1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32a74b1457b45d9928e7435f402ab76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:36Z,use_quota=True,user_id='94c1cf1a986841fcb8dc0667973e4553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a4b915-07b7-42fb-8552-de5fe41382fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a4b915-07b7-42fb-8552-de5fe41382fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64400650-a1d6-4db3-bdf7-623af1903ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64400650-a1d6-4db3-bdf7-623af1903ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f95a4c36-67db-4d47-a8aa-28e535edd1c9', 'volume_name': 'volume-f95a4c36-67db-4d47-a8aa-28e535edd1c9', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8941c16-edc5-47f6-acbf-c2d8fdb0f52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8941c16-edc5-47f6-acbf-c2d8fdb0f52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79bf8b8d-3062-4402-a924-5e6a4dce2bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:36 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Volume f95a4c36-67db-4d47-a8aa-28e535edd1c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f95a4c36-67db-4d47-a8aa-28e535edd1c9', 'volume_size': 1} Jul 10 04:46:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Flow 'volume_create_manager' (ecd57bf9-7b61-4fb0-9d70-63f9d67ff192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11ead27-e8cd-4d30-9c4a-3de64c2439b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11ead27-e8cd-4d30-9c4a-3de64c2439b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1751689893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab18662f-fe15-4dd1-8a1d-8ae24bb75727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32a74b1457b45d9928e7435f402ab76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:37Z,use_quota=True,user_id='94c1cf1a986841fcb8dc0667973e4553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3459ebda-1a9b-4181-b870-48b8771814b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3459ebda-1a9b-4181-b870-48b8771814b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d4a0eb-9568-4eb1-a1f0-f8f20ae5b442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d4a0eb-9568-4eb1-a1f0-f8f20ae5b442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab18662f-fe15-4dd1-8a1d-8ae24bb75727', 'volume_name': 'volume-ab18662f-fe15-4dd1-8a1d-8ae24bb75727', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f225ac9d-fcc2-42c5-88e1-09aa5336ab00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f225ac9d-fcc2-42c5-88e1-09aa5336ab00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f763e2-bdf5-4428-bce7-40659b5acbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:37 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Volume ab18662f-fe15-4dd1-8a1d-8ae24bb75727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab18662f-fe15-4dd1-8a1d-8ae24bb75727', 'volume_size': 1} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:37 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0db0d535-3bfc-418b-82db-596493f3b31b" returned: 0 in 0.811s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.611s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1294955570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5220db1-1e41-4ada-8b99-b0298b5f6f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32a74b1457b45d9928e7435f402ab76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:35Z,use_quota=True,user_id='94c1cf1a986841fcb8dc0667973e4553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Creating volume a5220db1-1e41-4ada-8b99-b0298b5f6f7b {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:46:37 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a5220db1-1e41-4ada-8b99-b0298b5f6f7b 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db6d5df-19f9-4911-8b24-cea7852e4d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db0d535-3bfc-418b-82db-596493f3b31b', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f92843-6674-4166-9d52-6d48e5470f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:37 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a5220db1-1e41-4ada-8b99-b0298b5f6f7b 1073741824 Jul 10 04:46:37 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:37 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Volume volume-0db0d535-3bfc-418b-82db-596493f3b31b (0db0d535-3bfc-418b-82db-596493f3b31b): created successfully Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f92843-6674-4166-9d52-6d48e5470f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Flow 'volume_create_manager' (5ab81689-e35a-429c-8af3-cbde4c1d504f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:37 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-9ee74940-fa4b-4c9e-973a-6527517b497a tempest-CreateVolumesFromSnapshotTest-2089144724 None] Created volume successfully. Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ff7e3052-d23f-4ed1-9b4f-e1c7ec8bc84d tempest-AttachVolumeTestJSON-419527975 None] Acquiring lock "cinder-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ff7e3052-d23f-4ed1-9b4f-e1c7ec8bc84d tempest-AttachVolumeTestJSON-419527975 None] Lock "cinder-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ff7e3052-d23f-4ed1-9b4f-e1c7ec8bc84d tempest-AttachVolumeTestJSON-419527975 None] Acquiring lock "cinder-quobyte-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ff7e3052-d23f-4ed1-9b4f-e1c7ec8bc84d tempest-AttachVolumeTestJSON-419527975 None] Lock "cinder-quobyte-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c" acquired by "delete_volume" :: waited 0.013s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[95632726-f545-4ce7-aa5c-59f2433c4231]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff7e3052-d23f-4ed1-9b4f-e1c7ec8bc84d tempest-AttachVolumeTestJSON-419527975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:37 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c Jul 10 04:46:37 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:38 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a5220db1-1e41-4ada-8b99-b0298b5f6f7b 1073741824" returned: 0 in 0.957s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a5220db1-1e41-4ada-8b99-b0298b5f6f7b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:38 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a5220db1-1e41-4ada-8b99-b0298b5f6f7b Jul 10 04:46:38 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:38 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff7e3052-d23f-4ed1-9b4f-e1c7ec8bc84d tempest-AttachVolumeTestJSON-419527975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c" returned: 0 in 0.843s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff7e3052-d23f-4ed1-9b4f-e1c7ec8bc84d tempest-AttachVolumeTestJSON-419527975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:38 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c Jul 10 04:46:38 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:38 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a5220db1-1e41-4ada-8b99-b0298b5f6f7b" returned: 0 in 0.674s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:38 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:46:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.743s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:38 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1583821754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cedfdbbe-c2a2-4187-868a-19dacc7e6565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32a74b1457b45d9928e7435f402ab76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:36Z,use_quota=True,user_id='94c1cf1a986841fcb8dc0667973e4553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:46:38 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Creating volume cedfdbbe-c2a2-4187-868a-19dacc7e6565 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:46:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:38 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:38 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:38 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:46:38 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:46:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cedfdbbe-c2a2-4187-868a-19dacc7e6565 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:38 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cedfdbbe-c2a2-4187-868a-19dacc7e6565 1073741824 Jul 10 04:46:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef89842f-b25f-4920-899a-511405cac500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5220db1-1e41-4ada-8b99-b0298b5f6f7b', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:38 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c13945-67a3-45d1-bc6b-4433342c40a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:38 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Volume volume-a5220db1-1e41-4ada-8b99-b0298b5f6f7b (a5220db1-1e41-4ada-8b99-b0298b5f6f7b): created successfully Jul 10 04:46:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c13945-67a3-45d1-bc6b-4433342c40a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Flow 'volume_create_manager' (4ea09245-bc30-4672-a579-b59b45ee23f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:38 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c257032b-ed17-4132-acaa-5e831fb19dd8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Created volume successfully. Jul 10 04:46:39 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff7e3052-d23f-4ed1-9b4f-e1c7ec8bc84d tempest-AttachVolumeTestJSON-419527975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c" returned: 0 in 0.696s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ff7e3052-d23f-4ed1-9b4f-e1c7ec8bc84d tempest-AttachVolumeTestJSON-419527975 None] Lock "cinder-quobyte-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c" released by "delete_volume" :: held 1.579s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:39 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-ff7e3052-d23f-4ed1-9b4f-e1c7ec8bc84d tempest-AttachVolumeTestJSON-419527975 None] Created reservations ['f596d5ed-498a-4c2e-b459-5342b07762ff', 'b8818a76-93c9-41ea-9906-84bb2b398b05', '24d81749-fc0a-44bb-a14c-c10e7e829985', '04840c0e-5643-4c21-b26f-d9278de0aac8'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:46:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ff7e3052-d23f-4ed1-9b4f-e1c7ec8bc84d tempest-AttachVolumeTestJSON-419527975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ff7e3052-d23f-4ed1-9b4f-e1c7ec8bc84d tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ff7e3052-d23f-4ed1-9b4f-e1c7ec8bc84d tempest-AttachVolumeTestJSON-419527975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ff7e3052-d23f-4ed1-9b4f-e1c7ec8bc84d tempest-AttachVolumeTestJSON-419527975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ff7e3052-d23f-4ed1-9b4f-e1c7ec8bc84d tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff7e3052-d23f-4ed1-9b4f-e1c7ec8bc84d tempest-AttachVolumeTestJSON-419527975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:39 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:46:39 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:39 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cedfdbbe-c2a2-4187-868a-19dacc7e6565 1073741824" returned: 0 in 0.871s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cedfdbbe-c2a2-4187-868a-19dacc7e6565 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:39 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cedfdbbe-c2a2-4187-868a-19dacc7e6565 Jul 10 04:46:39 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c0a00ad1-1d0f-479b-94e5-be50519e2714 tempest-AttachVolumeTestJSON-419527975 None] Acquiring lock "cinder-407dcae8-f5e0-420e-9161-06e9d72d2cda-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c0a00ad1-1d0f-479b-94e5-be50519e2714 tempest-AttachVolumeTestJSON-419527975 None] Lock "cinder-407dcae8-f5e0-420e-9161-06e9d72d2cda-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c0a00ad1-1d0f-479b-94e5-be50519e2714 tempest-AttachVolumeTestJSON-419527975 None] Acquiring lock "cinder-quobyte-407dcae8-f5e0-420e-9161-06e9d72d2cda" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c0a00ad1-1d0f-479b-94e5-be50519e2714 tempest-AttachVolumeTestJSON-419527975 None] Lock "cinder-quobyte-407dcae8-f5e0-420e-9161-06e9d72d2cda" acquired by "delete_volume" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:39 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[1672cbfd-b9c9-4980-917f-e177f7c82b53]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0a00ad1-1d0f-479b-94e5-be50519e2714 tempest-AttachVolumeTestJSON-419527975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-407dcae8-f5e0-420e-9161-06e9d72d2cda {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:40 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff7e3052-d23f-4ed1-9b4f-e1c7ec8bc84d tempest-AttachVolumeTestJSON-419527975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.716s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:40 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-ff7e3052-d23f-4ed1-9b4f-e1c7ec8bc84d tempest-AttachVolumeTestJSON-419527975 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:40 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ff7e3052-d23f-4ed1-9b4f-e1c7ec8bc84d tempest-AttachVolumeTestJSON-419527975 None] Deleted volume successfully. Jul 10 04:46:40 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-407dcae8-f5e0-420e-9161-06e9d72d2cda Jul 10 04:46:40 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:40 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ff7e3052-d23f-4ed1-9b4f-e1c7ec8bc84d tempest-AttachVolumeTestJSON-419527975 None] Lock "cinder-e51f36d6-2afc-41e2-b7fd-0fbac96fec9c-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:40 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cedfdbbe-c2a2-4187-868a-19dacc7e6565" returned: 0 in 0.703s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:46:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.860s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1541718831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f95a4c36-67db-4d47-a8aa-28e535edd1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32a74b1457b45d9928e7435f402ab76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:36Z,use_quota=True,user_id='94c1cf1a986841fcb8dc0667973e4553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:46:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Creating volume f95a4c36-67db-4d47-a8aa-28e535edd1c9 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:46:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:46:40 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:46:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f95a4c36-67db-4d47-a8aa-28e535edd1c9 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:40 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f95a4c36-67db-4d47-a8aa-28e535edd1c9 1073741824 Jul 10 04:46:40 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:40 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45922736-5df2-43f8-9e13-b69774aed12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cedfdbbe-c2a2-4187-868a-19dacc7e6565', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:40 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3691e325-f8ca-4732-ad47-860142ae2d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:40 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Volume volume-cedfdbbe-c2a2-4187-868a-19dacc7e6565 (cedfdbbe-c2a2-4187-868a-19dacc7e6565): created successfully Jul 10 04:46:40 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3691e325-f8ca-4732-ad47-860142ae2d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:40 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Flow 'volume_create_manager' (69d60c2c-6790-425c-ba37-e03cad1fc2c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:40 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-3b23f1c1-ae47-4c47-8f92-89e314f7d914 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Created volume successfully. Jul 10 04:46:40 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0a00ad1-1d0f-479b-94e5-be50519e2714 tempest-AttachVolumeTestJSON-419527975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-407dcae8-f5e0-420e-9161-06e9d72d2cda" returned: 0 in 0.821s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0a00ad1-1d0f-479b-94e5-be50519e2714 tempest-AttachVolumeTestJSON-419527975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-407dcae8-f5e0-420e-9161-06e9d72d2cda {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:40 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-407dcae8-f5e0-420e-9161-06e9d72d2cda Jul 10 04:46:40 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:41 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f95a4c36-67db-4d47-a8aa-28e535edd1c9 1073741824" returned: 0 in 0.864s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f95a4c36-67db-4d47-a8aa-28e535edd1c9 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:41 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f95a4c36-67db-4d47-a8aa-28e535edd1c9 Jul 10 04:46:41 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:41 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0a00ad1-1d0f-479b-94e5-be50519e2714 tempest-AttachVolumeTestJSON-419527975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-407dcae8-f5e0-420e-9161-06e9d72d2cda" returned: 0 in 0.699s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c0a00ad1-1d0f-479b-94e5-be50519e2714 tempest-AttachVolumeTestJSON-419527975 None] Lock "cinder-quobyte-407dcae8-f5e0-420e-9161-06e9d72d2cda" released by "delete_volume" :: held 1.580s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:41 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-c0a00ad1-1d0f-479b-94e5-be50519e2714 tempest-AttachVolumeTestJSON-419527975 None] Created reservations ['3fe2b6ea-8962-4557-9b94-aa65219564bc', 'fd2440be-709e-4111-821e-ba234b51985a', '23a9e680-9417-4968-9fea-d6648a6f0add', '7a2467ed-481d-4c31-a243-2d30d626ebad'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:46:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c0a00ad1-1d0f-479b-94e5-be50519e2714 tempest-AttachVolumeTestJSON-419527975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c0a00ad1-1d0f-479b-94e5-be50519e2714 tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c0a00ad1-1d0f-479b-94e5-be50519e2714 tempest-AttachVolumeTestJSON-419527975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c0a00ad1-1d0f-479b-94e5-be50519e2714 tempest-AttachVolumeTestJSON-419527975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c0a00ad1-1d0f-479b-94e5-be50519e2714 tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0a00ad1-1d0f-479b-94e5-be50519e2714 tempest-AttachVolumeTestJSON-419527975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:41 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:46:41 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:42 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f95a4c36-67db-4d47-a8aa-28e535edd1c9" returned: 0 in 0.755s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.060s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1751689893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab18662f-fe15-4dd1-8a1d-8ae24bb75727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32a74b1457b45d9928e7435f402ab76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:37Z,use_quota=True,user_id='94c1cf1a986841fcb8dc0667973e4553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Creating volume ab18662f-fe15-4dd1-8a1d-8ae24bb75727 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:46:42 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ab18662f-fe15-4dd1-8a1d-8ae24bb75727 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f0a47494-20be-4ead-ad31-ec691904e354 tempest-AttachVolumeTestJSON-419527975 None] Acquiring lock "cinder-7144ea34-0a8a-4ae6-8322-0838c81c743e-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:42 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ab18662f-fe15-4dd1-8a1d-8ae24bb75727 1073741824 Jul 10 04:46:42 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79bf8b8d-3062-4402-a924-5e6a4dce2bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f95a4c36-67db-4d47-a8aa-28e535edd1c9', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab445a8e-421f-43a3-98de-310665a93d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f0a47494-20be-4ead-ad31-ec691904e354 tempest-AttachVolumeTestJSON-419527975 None] Lock "cinder-7144ea34-0a8a-4ae6-8322-0838c81c743e-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:42 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Volume volume-f95a4c36-67db-4d47-a8aa-28e535edd1c9 (f95a4c36-67db-4d47-a8aa-28e535edd1c9): created successfully Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab445a8e-421f-43a3-98de-310665a93d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Flow 'volume_create_manager' (6368ce1b-f5ff-44ce-b90f-0dde39b43c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:42 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-2486fab7-def5-4de7-a984-75de35b77f9e tempest-CreateVolumesFromSnapshotTest-2089144724 None] Created volume successfully. Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f0a47494-20be-4ead-ad31-ec691904e354 tempest-AttachVolumeTestJSON-419527975 None] Acquiring lock "cinder-quobyte-7144ea34-0a8a-4ae6-8322-0838c81c743e" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f0a47494-20be-4ead-ad31-ec691904e354 tempest-AttachVolumeTestJSON-419527975 None] Lock "cinder-quobyte-7144ea34-0a8a-4ae6-8322-0838c81c743e" acquired by "delete_volume" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be6bcb9-2617-401e-9257-3e3a3e5a9625]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f0a47494-20be-4ead-ad31-ec691904e354 tempest-AttachVolumeTestJSON-419527975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7144ea34-0a8a-4ae6-8322-0838c81c743e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:42 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0a00ad1-1d0f-479b-94e5-be50519e2714 tempest-AttachVolumeTestJSON-419527975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.902s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-c0a00ad1-1d0f-479b-94e5-be50519e2714 tempest-AttachVolumeTestJSON-419527975 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:42 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c0a00ad1-1d0f-479b-94e5-be50519e2714 tempest-AttachVolumeTestJSON-419527975 None] Deleted volume successfully. Jul 10 04:46:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c0a00ad1-1d0f-479b-94e5-be50519e2714 tempest-AttachVolumeTestJSON-419527975 None] Lock "cinder-407dcae8-f5e0-420e-9161-06e9d72d2cda-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:42 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7144ea34-0a8a-4ae6-8322-0838c81c743e Jul 10 04:46:42 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:43 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ab18662f-fe15-4dd1-8a1d-8ae24bb75727 1073741824" returned: 0 in 1.172s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ab18662f-fe15-4dd1-8a1d-8ae24bb75727 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:43 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ab18662f-fe15-4dd1-8a1d-8ae24bb75727 Jul 10 04:46:43 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:43 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f0a47494-20be-4ead-ad31-ec691904e354 tempest-AttachVolumeTestJSON-419527975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7144ea34-0a8a-4ae6-8322-0838c81c743e" returned: 0 in 1.055s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f0a47494-20be-4ead-ad31-ec691904e354 tempest-AttachVolumeTestJSON-419527975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7144ea34-0a8a-4ae6-8322-0838c81c743e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:43 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7144ea34-0a8a-4ae6-8322-0838c81c743e Jul 10 04:46:43 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:44 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ab18662f-fe15-4dd1-8a1d-8ae24bb75727" returned: 0 in 0.798s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] <== create_volume: return (2035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:46:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.041s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:44 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f763e2-bdf5-4428-bce7-40659b5acbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab18662f-fe15-4dd1-8a1d-8ae24bb75727', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:44 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa157a4a-a938-4183-8a5b-2adc4057c5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:44 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Volume volume-ab18662f-fe15-4dd1-8a1d-8ae24bb75727 (ab18662f-fe15-4dd1-8a1d-8ae24bb75727): created successfully Jul 10 04:46:44 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa157a4a-a938-4183-8a5b-2adc4057c5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:44 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Flow 'volume_create_manager' (ecd57bf9-7b61-4fb0-9d70-63f9d67ff192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:44 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-001f1116-32b6-42d0-aed0-f01fef80a0ca tempest-CreateVolumesFromSnapshotTest-2089144724 None] Created volume successfully. Jul 10 04:46:44 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f0a47494-20be-4ead-ad31-ec691904e354 tempest-AttachVolumeTestJSON-419527975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7144ea34-0a8a-4ae6-8322-0838c81c743e" returned: 0 in 0.724s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:44 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f0a47494-20be-4ead-ad31-ec691904e354 tempest-AttachVolumeTestJSON-419527975 None] Lock "cinder-quobyte-7144ea34-0a8a-4ae6-8322-0838c81c743e" released by "delete_volume" :: held 1.841s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:44 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-f0a47494-20be-4ead-ad31-ec691904e354 tempest-AttachVolumeTestJSON-419527975 None] Created reservations ['313c644a-b859-49e3-b20f-bab538242fad', '6e19cf51-60b9-4fa3-82ac-57ecd8306bf8', 'ba34e78d-7282-415e-81ad-6dc59422f088', '14f4feff-b771-49a3-94ff-36bd56bded99'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:46:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f0a47494-20be-4ead-ad31-ec691904e354 tempest-AttachVolumeTestJSON-419527975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f0a47494-20be-4ead-ad31-ec691904e354 tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f0a47494-20be-4ead-ad31-ec691904e354 tempest-AttachVolumeTestJSON-419527975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f0a47494-20be-4ead-ad31-ec691904e354 tempest-AttachVolumeTestJSON-419527975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f0a47494-20be-4ead-ad31-ec691904e354 tempest-AttachVolumeTestJSON-419527975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f0a47494-20be-4ead-ad31-ec691904e354 tempest-AttachVolumeTestJSON-419527975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:44 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:46:44 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:44 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-86066f2b-7747-4195-84c8-e527af8216a8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "cinder-ab18662f-fe15-4dd1-8a1d-8ae24bb75727-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:44 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-86066f2b-7747-4195-84c8-e527af8216a8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-ab18662f-fe15-4dd1-8a1d-8ae24bb75727-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:44 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-86066f2b-7747-4195-84c8-e527af8216a8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "cinder-quobyte-ab18662f-fe15-4dd1-8a1d-8ae24bb75727" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:44 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-86066f2b-7747-4195-84c8-e527af8216a8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-quobyte-ab18662f-fe15-4dd1-8a1d-8ae24bb75727" acquired by "delete_volume" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:44 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d504e2-a45f-4404-bbe0-78bca1d2f0af]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-86066f2b-7747-4195-84c8-e527af8216a8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ab18662f-fe15-4dd1-8a1d-8ae24bb75727 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:44 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ab18662f-fe15-4dd1-8a1d-8ae24bb75727 Jul 10 04:46:44 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:45 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f0a47494-20be-4ead-ad31-ec691904e354 tempest-AttachVolumeTestJSON-419527975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.703s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:45 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-f0a47494-20be-4ead-ad31-ec691904e354 tempest-AttachVolumeTestJSON-419527975 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:45 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-f0a47494-20be-4ead-ad31-ec691904e354 tempest-AttachVolumeTestJSON-419527975 None] Deleted volume successfully. Jul 10 04:46:45 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f0a47494-20be-4ead-ad31-ec691904e354 tempest-AttachVolumeTestJSON-419527975 None] Lock "cinder-7144ea34-0a8a-4ae6-8322-0838c81c743e-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:45 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-86066f2b-7747-4195-84c8-e527af8216a8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ab18662f-fe15-4dd1-8a1d-8ae24bb75727" returned: 0 in 0.838s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-86066f2b-7747-4195-84c8-e527af8216a8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ab18662f-fe15-4dd1-8a1d-8ae24bb75727 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:45 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ab18662f-fe15-4dd1-8a1d-8ae24bb75727 Jul 10 04:46:45 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:46 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-86066f2b-7747-4195-84c8-e527af8216a8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ab18662f-fe15-4dd1-8a1d-8ae24bb75727" returned: 0 in 0.694s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:46 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-86066f2b-7747-4195-84c8-e527af8216a8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-quobyte-ab18662f-fe15-4dd1-8a1d-8ae24bb75727" released by "delete_volume" :: held 1.578s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:46 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=94,cinder:INSERT=25,cinder:UPDATE=136,cinder:DELETE=9 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:46:46 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-86066f2b-7747-4195-84c8-e527af8216a8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Created reservations ['68950561-8966-4fe8-a9ef-1a077a0bb403', '5c465eb7-11a9-49b1-9ac3-3b0e0d7eaa5e', '8b93da06-0c58-4d2a-b17f-5ccd6ee213b1', '70e05c5f-777c-4e86-a04e-83118951800b'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:46:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-86066f2b-7747-4195-84c8-e527af8216a8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-86066f2b-7747-4195-84c8-e527af8216a8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-86066f2b-7747-4195-84c8-e527af8216a8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-86066f2b-7747-4195-84c8-e527af8216a8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-86066f2b-7747-4195-84c8-e527af8216a8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-86066f2b-7747-4195-84c8-e527af8216a8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:46 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:46:46 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:46 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-28794a2d-7d9f-48b0-bc30-2822d702e7cb tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "cinder-f95a4c36-67db-4d47-a8aa-28e535edd1c9-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:46 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-28794a2d-7d9f-48b0-bc30-2822d702e7cb tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-f95a4c36-67db-4d47-a8aa-28e535edd1c9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-28794a2d-7d9f-48b0-bc30-2822d702e7cb tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "cinder-quobyte-f95a4c36-67db-4d47-a8aa-28e535edd1c9" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-28794a2d-7d9f-48b0-bc30-2822d702e7cb tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-quobyte-f95a4c36-67db-4d47-a8aa-28e535edd1c9" acquired by "delete_volume" :: waited 0.032s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:47 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[f900f502-bb69-4d73-8c3f-eb147f198dcf]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-28794a2d-7d9f-48b0-bc30-2822d702e7cb tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f95a4c36-67db-4d47-a8aa-28e535edd1c9 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:47 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f95a4c36-67db-4d47-a8aa-28e535edd1c9 Jul 10 04:46:47 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:47 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-86066f2b-7747-4195-84c8-e527af8216a8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.929s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:47 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-86066f2b-7747-4195-84c8-e527af8216a8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:47 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-86066f2b-7747-4195-84c8-e527af8216a8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Deleted volume successfully. Jul 10 04:46:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-86066f2b-7747-4195-84c8-e527af8216a8 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-ab18662f-fe15-4dd1-8a1d-8ae24bb75727-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:48 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-28794a2d-7d9f-48b0-bc30-2822d702e7cb tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f95a4c36-67db-4d47-a8aa-28e535edd1c9" returned: 0 in 1.026s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-28794a2d-7d9f-48b0-bc30-2822d702e7cb tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f95a4c36-67db-4d47-a8aa-28e535edd1c9 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:48 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f95a4c36-67db-4d47-a8aa-28e535edd1c9 Jul 10 04:46:48 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:48 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-28794a2d-7d9f-48b0-bc30-2822d702e7cb tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f95a4c36-67db-4d47-a8aa-28e535edd1c9" returned: 0 in 0.800s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:48 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-28794a2d-7d9f-48b0-bc30-2822d702e7cb tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-quobyte-f95a4c36-67db-4d47-a8aa-28e535edd1c9" released by "delete_volume" :: held 1.928s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:49 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-28794a2d-7d9f-48b0-bc30-2822d702e7cb tempest-CreateVolumesFromSnapshotTest-2089144724 None] Created reservations ['8d788d3e-ce36-4170-a616-62f879ac2d66', '5bcac2f4-f289-4487-aabc-d52d15b86140', '364b49cd-2986-46b1-b8dc-928a3745a2de', 'b835c1ca-de5f-46d7-8ca4-a12fa28cf02d'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:46:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-28794a2d-7d9f-48b0-bc30-2822d702e7cb tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-28794a2d-7d9f-48b0-bc30-2822d702e7cb tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-28794a2d-7d9f-48b0-bc30-2822d702e7cb tempest-CreateVolumesFromSnapshotTest-2089144724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-28794a2d-7d9f-48b0-bc30-2822d702e7cb tempest-CreateVolumesFromSnapshotTest-2089144724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-28794a2d-7d9f-48b0-bc30-2822d702e7cb tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-28794a2d-7d9f-48b0-bc30-2822d702e7cb tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:49 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:46:49 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:49 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c9fd1a61-ca1e-4ee6-b181-b21f6a33161d tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "cinder-cedfdbbe-c2a2-4187-868a-19dacc7e6565-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:49 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c9fd1a61-ca1e-4ee6-b181-b21f6a33161d tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-cedfdbbe-c2a2-4187-868a-19dacc7e6565-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:49 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c9fd1a61-ca1e-4ee6-b181-b21f6a33161d tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "cinder-quobyte-cedfdbbe-c2a2-4187-868a-19dacc7e6565" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:49 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c9fd1a61-ca1e-4ee6-b181-b21f6a33161d tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-quobyte-cedfdbbe-c2a2-4187-868a-19dacc7e6565" acquired by "delete_volume" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:49 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6440d57-225d-47ff-87c0-664279b13787]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c9fd1a61-ca1e-4ee6-b181-b21f6a33161d tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cedfdbbe-c2a2-4187-868a-19dacc7e6565 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:49 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cedfdbbe-c2a2-4187-868a-19dacc7e6565 Jul 10 04:46:49 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:50 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-28794a2d-7d9f-48b0-bc30-2822d702e7cb tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.903s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:50 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-28794a2d-7d9f-48b0-bc30-2822d702e7cb tempest-CreateVolumesFromSnapshotTest-2089144724 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:50 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-28794a2d-7d9f-48b0-bc30-2822d702e7cb tempest-CreateVolumesFromSnapshotTest-2089144724 None] Deleted volume successfully. Jul 10 04:46:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-28794a2d-7d9f-48b0-bc30-2822d702e7cb tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-f95a4c36-67db-4d47-a8aa-28e535edd1c9-delete_volume" released by "delete_volume" :: held 3.204s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:50 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c9fd1a61-ca1e-4ee6-b181-b21f6a33161d tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cedfdbbe-c2a2-4187-868a-19dacc7e6565" returned: 0 in 1.081s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c9fd1a61-ca1e-4ee6-b181-b21f6a33161d tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cedfdbbe-c2a2-4187-868a-19dacc7e6565 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:50 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cedfdbbe-c2a2-4187-868a-19dacc7e6565 Jul 10 04:46:50 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:51 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c9fd1a61-ca1e-4ee6-b181-b21f6a33161d tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-cedfdbbe-c2a2-4187-868a-19dacc7e6565" returned: 0 in 0.852s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c9fd1a61-ca1e-4ee6-b181-b21f6a33161d tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-quobyte-cedfdbbe-c2a2-4187-868a-19dacc7e6565" released by "delete_volume" :: held 2.013s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:51 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-c9fd1a61-ca1e-4ee6-b181-b21f6a33161d tempest-CreateVolumesFromSnapshotTest-2089144724 None] Created reservations ['2b7ef37f-632f-4dba-8539-d4d741486e2c', '27fe82ad-8fe1-47f9-8e09-5e2e3d2b41cc', 'd4696ed9-d93d-4d31-876b-6c00002b2e32', 'c583ce36-c743-4dfe-9576-33b5655676aa'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:46:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c9fd1a61-ca1e-4ee6-b181-b21f6a33161d tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c9fd1a61-ca1e-4ee6-b181-b21f6a33161d tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:51 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c9fd1a61-ca1e-4ee6-b181-b21f6a33161d tempest-CreateVolumesFromSnapshotTest-2089144724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:51 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c9fd1a61-ca1e-4ee6-b181-b21f6a33161d tempest-CreateVolumesFromSnapshotTest-2089144724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c9fd1a61-ca1e-4ee6-b181-b21f6a33161d tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c9fd1a61-ca1e-4ee6-b181-b21f6a33161d tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:51 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:46:51 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:52 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c9fd1a61-ca1e-4ee6-b181-b21f6a33161d tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.898s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:52 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-c9fd1a61-ca1e-4ee6-b181-b21f6a33161d tempest-CreateVolumesFromSnapshotTest-2089144724 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:52 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c9fd1a61-ca1e-4ee6-b181-b21f6a33161d tempest-CreateVolumesFromSnapshotTest-2089144724 None] Deleted volume successfully. Jul 10 04:46:52 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=127,cinder:SELECT=105,cinder:DELETE=16,cinder:INSERT=38 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:46:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c9fd1a61-ca1e-4ee6-b181-b21f6a33161d tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-cedfdbbe-c2a2-4187-868a-19dacc7e6565-delete_volume" released by "delete_volume" :: held 3.297s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-44b6aba2-26cd-4895-8f37-4a8c81f6daec tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "cinder-a5220db1-1e41-4ada-8b99-b0298b5f6f7b-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-44b6aba2-26cd-4895-8f37-4a8c81f6daec tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-a5220db1-1e41-4ada-8b99-b0298b5f6f7b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-44b6aba2-26cd-4895-8f37-4a8c81f6daec tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "cinder-quobyte-a5220db1-1e41-4ada-8b99-b0298b5f6f7b" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-44b6aba2-26cd-4895-8f37-4a8c81f6daec tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-quobyte-a5220db1-1e41-4ada-8b99-b0298b5f6f7b" acquired by "delete_volume" :: waited 0.026s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:52 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cbedd8-631e-4170-8e2e-41999cc74f13]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-44b6aba2-26cd-4895-8f37-4a8c81f6daec tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a5220db1-1e41-4ada-8b99-b0298b5f6f7b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:53 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a5220db1-1e41-4ada-8b99-b0298b5f6f7b Jul 10 04:46:53 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:53 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-44b6aba2-26cd-4895-8f37-4a8c81f6daec tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a5220db1-1e41-4ada-8b99-b0298b5f6f7b" returned: 0 in 1.059s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-44b6aba2-26cd-4895-8f37-4a8c81f6daec tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a5220db1-1e41-4ada-8b99-b0298b5f6f7b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:54 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a5220db1-1e41-4ada-8b99-b0298b5f6f7b Jul 10 04:46:54 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:54 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-44b6aba2-26cd-4895-8f37-4a8c81f6daec tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a5220db1-1e41-4ada-8b99-b0298b5f6f7b" returned: 0 in 0.685s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-44b6aba2-26cd-4895-8f37-4a8c81f6daec tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-quobyte-a5220db1-1e41-4ada-8b99-b0298b5f6f7b" released by "delete_volume" :: held 1.805s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:54 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-44b6aba2-26cd-4895-8f37-4a8c81f6daec tempest-CreateVolumesFromSnapshotTest-2089144724 None] Created reservations ['287ced55-7cec-4890-bca5-568ea645b590', 'da7a4b7e-cd7b-4ce2-af6d-cffdd487d338', '68211b67-118e-47ee-bc49-4e82a8c53d06', '550c9871-720d-4b48-8f83-af3422039415'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:46:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-44b6aba2-26cd-4895-8f37-4a8c81f6daec tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-44b6aba2-26cd-4895-8f37-4a8c81f6daec tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-44b6aba2-26cd-4895-8f37-4a8c81f6daec tempest-CreateVolumesFromSnapshotTest-2089144724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-44b6aba2-26cd-4895-8f37-4a8c81f6daec tempest-CreateVolumesFromSnapshotTest-2089144724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-44b6aba2-26cd-4895-8f37-4a8c81f6daec tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-44b6aba2-26cd-4895-8f37-4a8c81f6daec tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:54 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:46:54 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-190dce8e-afd6-4e62-8e61-aaf89f485f97 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "cinder-0db0d535-3bfc-418b-82db-596493f3b31b-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-190dce8e-afd6-4e62-8e61-aaf89f485f97 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-0db0d535-3bfc-418b-82db-596493f3b31b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:55 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-59436340-6d7a-46ba-a57d-d6764c15555e tempest-BackendsCapabilitiesAdminTestsJSON-670174619 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87359) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4881}} Jul 10 04:46:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-190dce8e-afd6-4e62-8e61-aaf89f485f97 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "cinder-quobyte-0db0d535-3bfc-418b-82db-596493f3b31b" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-190dce8e-afd6-4e62-8e61-aaf89f485f97 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-quobyte-0db0d535-3bfc-418b-82db-596493f3b31b" acquired by "delete_volume" :: waited 0.044s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:55 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b17b31-8269-4ca9-b4a2-e05699913d89]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-190dce8e-afd6-4e62-8e61-aaf89f485f97 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0db0d535-3bfc-418b-82db-596493f3b31b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:55 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0db0d535-3bfc-418b-82db-596493f3b31b Jul 10 04:46:55 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:55 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4970233d-58f2-44da-a02b-0c10e327f13c tempest-BackendsCapabilitiesAdminTestsJSON-670174619 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87359) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4881}} Jul 10 04:46:55 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-44b6aba2-26cd-4895-8f37-4a8c81f6daec tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.889s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:55 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-44b6aba2-26cd-4895-8f37-4a8c81f6daec tempest-CreateVolumesFromSnapshotTest-2089144724 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:55 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-44b6aba2-26cd-4895-8f37-4a8c81f6daec tempest-CreateVolumesFromSnapshotTest-2089144724 None] Deleted volume successfully. Jul 10 04:46:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-44b6aba2-26cd-4895-8f37-4a8c81f6daec tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-a5220db1-1e41-4ada-8b99-b0298b5f6f7b-delete_volume" released by "delete_volume" :: held 2.970s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:56 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-190dce8e-afd6-4e62-8e61-aaf89f485f97 tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0db0d535-3bfc-418b-82db-596493f3b31b" returned: 0 in 0.802s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-190dce8e-afd6-4e62-8e61-aaf89f485f97 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0db0d535-3bfc-418b-82db-596493f3b31b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:56 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0db0d535-3bfc-418b-82db-596493f3b31b Jul 10 04:46:56 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:56 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-190dce8e-afd6-4e62-8e61-aaf89f485f97 tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0db0d535-3bfc-418b-82db-596493f3b31b" returned: 0 in 0.697s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-190dce8e-afd6-4e62-8e61-aaf89f485f97 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-quobyte-0db0d535-3bfc-418b-82db-596493f3b31b" released by "delete_volume" :: held 1.545s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:56 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-190dce8e-afd6-4e62-8e61-aaf89f485f97 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Created reservations ['dcc21d7f-8542-4942-9673-ffc6d919b52c', '65cb77d4-03b8-49b7-9072-c1ba1907715f', 'e9f5944f-0b3e-4af9-ab86-b2b543125f2c', 'd3aacd88-a325-4df0-9c5e-f309e14772fa'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:46:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-190dce8e-afd6-4e62-8e61-aaf89f485f97 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-190dce8e-afd6-4e62-8e61-aaf89f485f97 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-190dce8e-afd6-4e62-8e61-aaf89f485f97 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-190dce8e-afd6-4e62-8e61-aaf89f485f97 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-190dce8e-afd6-4e62-8e61-aaf89f485f97 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-190dce8e-afd6-4e62-8e61-aaf89f485f97 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:56 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:46:56 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cf2e8394-d2af-453a-9605-6e3ed115f82b tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "cinder-5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cf2e8394-d2af-453a-9605-6e3ed115f82b tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cf2e8394-d2af-453a-9605-6e3ed115f82b tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "cinder-quobyte-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cf2e8394-d2af-453a-9605-6e3ed115f82b tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-quobyte-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cf2e8394-d2af-453a-9605-6e3ed115f82b tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "cinder-quobyte-5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cf2e8394-d2af-453a-9605-6e3ed115f82b tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-quobyte-5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:57 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-cf2e8394-d2af-453a-9605-6e3ed115f82b tempest-CreateVolumesFromSnapshotTest-2089144724 None] Deleting offline snapshot 5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4 of volume a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:46:57 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-cf2e8394-d2af-453a-9605-6e3ed115f82b tempest-CreateVolumesFromSnapshotTest-2089144724 None] snapshot_file for this snap is: volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:46:57 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[6449bc77-07f8-4043-9f4b-4a34f170fe66]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cf2e8394-d2af-453a-9605-6e3ed115f82b tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:57 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4 Jul 10 04:46:57 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:57 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-190dce8e-afd6-4e62-8e61-aaf89f485f97 tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.832s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:57 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-190dce8e-afd6-4e62-8e61-aaf89f485f97 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:57 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-190dce8e-afd6-4e62-8e61-aaf89f485f97 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Deleted volume successfully. Jul 10 04:46:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-190dce8e-afd6-4e62-8e61-aaf89f485f97 tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-0db0d535-3bfc-418b-82db-596493f3b31b-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:58 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cf2e8394-d2af-453a-9605-6e3ed115f82b tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4" returned: 0 in 1.009s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-cf2e8394-d2af-453a-9605-6e3ed115f82b tempest-CreateVolumesFromSnapshotTest-2089144724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:46:58 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b32270c-ebca-4c77-9499-45d305893b79]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cf2e8394-d2af-453a-9605-6e3ed115f82b tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:58 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6 Jul 10 04:46:58 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:59 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cf2e8394-d2af-453a-9605-6e3ed115f82b tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6" returned: 0 in 0.861s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cf2e8394-d2af-453a-9605-6e3ed115f82b tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:59 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4 Jul 10 04:46:59 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:00 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cf2e8394-d2af-453a-9605-6e3ed115f82b tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4" returned: 0 in 0.828s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cf2e8394-d2af-453a-9605-6e3ed115f82b tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:00 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4 Jul 10 04:47:00 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:00 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cf2e8394-d2af-453a-9605-6e3ed115f82b tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6.5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4" returned: 0 in 0.682s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cf2e8394-d2af-453a-9605-6e3ed115f82b tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-quobyte-5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4" released by "_delete_snapshot" :: held 3.521s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cf2e8394-d2af-453a-9605-6e3ed115f82b tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-quobyte-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6" released by "delete_snapshot" :: held 3.558s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:01 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-cf2e8394-d2af-453a-9605-6e3ed115f82b tempest-CreateVolumesFromSnapshotTest-2089144724 None] Created reservations ['ac4af280-17e5-40fc-a070-80fc18ba819c', 'c5ed3658-2169-42e8-94b0-72b4746d606c', 'df08c10e-37f2-41ad-b457-906256ffccb3', 'd3895fd7-84a1-4b12-888a-4de2ce625b2c'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:47:01 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-cf2e8394-d2af-453a-9605-6e3ed115f82b tempest-CreateVolumesFromSnapshotTest-2089144724 None] Delete snapshot completed successfully. Jul 10 04:47:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cf2e8394-d2af-453a-9605-6e3ed115f82b tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-5f8aaaaf-166f-468d-a533-ac5ec4e8c4b4-delete_snapshot" released by "delete_snapshot" :: held 3.723s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e32fc71d-52f2-46bf-b8e2-5e4c62b8e7fe tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "cinder-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e32fc71d-52f2-46bf-b8e2-5e4c62b8e7fe tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e32fc71d-52f2-46bf-b8e2-5e4c62b8e7fe tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "cinder-quobyte-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e32fc71d-52f2-46bf-b8e2-5e4c62b8e7fe tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-quobyte-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6" acquired by "delete_volume" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:01 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2a5c87-4042-48a9-9776-5aafb488afeb]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e32fc71d-52f2-46bf-b8e2-5e4c62b8e7fe tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:02 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6 Jul 10 04:47:02 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:02 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e32fc71d-52f2-46bf-b8e2-5e4c62b8e7fe tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6" returned: 0 in 0.938s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e32fc71d-52f2-46bf-b8e2-5e4c62b8e7fe tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:02 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6 Jul 10 04:47:02 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:03 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e32fc71d-52f2-46bf-b8e2-5e4c62b8e7fe tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6" returned: 0 in 0.665s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e32fc71d-52f2-46bf-b8e2-5e4c62b8e7fe tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-quobyte-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6" released by "delete_volume" :: held 1.678s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:03 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-e32fc71d-52f2-46bf-b8e2-5e4c62b8e7fe tempest-CreateVolumesFromSnapshotTest-2089144724 None] Created reservations ['b106137e-072e-44c1-8ae0-76fc03506f08', 'f32be2eb-7ba1-4772-8bce-81d98f304ecd', '27fce985-c304-45c1-9307-2f538928bbc7', '42f83175-5835-46cf-a1fd-76ab541c8b79'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:47:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e32fc71d-52f2-46bf-b8e2-5e4c62b8e7fe tempest-CreateVolumesFromSnapshotTest-2089144724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e32fc71d-52f2-46bf-b8e2-5e4c62b8e7fe tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e32fc71d-52f2-46bf-b8e2-5e4c62b8e7fe tempest-CreateVolumesFromSnapshotTest-2089144724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e32fc71d-52f2-46bf-b8e2-5e4c62b8e7fe tempest-CreateVolumesFromSnapshotTest-2089144724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e32fc71d-52f2-46bf-b8e2-5e4c62b8e7fe tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e32fc71d-52f2-46bf-b8e2-5e4c62b8e7fe tempest-CreateVolumesFromSnapshotTest-2089144724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:03 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:47:03 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:04 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e32fc71d-52f2-46bf-b8e2-5e4c62b8e7fe tempest-CreateVolumesFromSnapshotTest-2089144724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.768s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:04 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-e32fc71d-52f2-46bf-b8e2-5e4c62b8e7fe tempest-CreateVolumesFromSnapshotTest-2089144724 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:47:04 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-e32fc71d-52f2-46bf-b8e2-5e4c62b8e7fe tempest-CreateVolumesFromSnapshotTest-2089144724 None] Deleted volume successfully. Jul 10 04:47:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e32fc71d-52f2-46bf-b8e2-5e4c62b8e7fe tempest-CreateVolumesFromSnapshotTest-2089144724 None] Lock "cinder-a917d5ea-b0e8-42c7-a144-5b3fd5ca3cb6-delete_volume" released by "delete_volume" :: held 2.724s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:07 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:47:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Flow 'volume_create_manager' (e8935b12-1df3-48a4-a22c-c59bde245537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (138c13e7-020d-4659-a2b0-79ef14ae3cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (138c13e7-020d-4659-a2b0-79ef14ae3cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1654125387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0750db9f-b504-4c4e-9180-6e397df13ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95f496812f64cefbfd6cde1cc309de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:07Z,use_quota=True,user_id='4bc049e469594bf8b06529afad35c5d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3857718-c82f-4d2e-897b-ef20e02b07cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3857718-c82f-4d2e-897b-ef20e02b07cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d3faf6-ab0f-4a25-9122-9918884a1722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d3faf6-ab0f-4a25-9122-9918884a1722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0750db9f-b504-4c4e-9180-6e397df13ab6', 'volume_name': 'volume-0750db9f-b504-4c4e-9180-6e397df13ab6', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7df11e-e97c-4cba-b3d1-08c380e56f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7df11e-e97c-4cba-b3d1-08c380e56f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f961b1c-ebce-4098-bd76-40a2cad9892c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:07 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Volume 0750db9f-b504-4c4e-9180-6e397df13ab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0750db9f-b504-4c4e-9180-6e397df13ab6', 'volume_size': 1} Jul 10 04:47:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1654125387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0750db9f-b504-4c4e-9180-6e397df13ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95f496812f64cefbfd6cde1cc309de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:07Z,use_quota=True,user_id='4bc049e469594bf8b06529afad35c5d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:47:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Creating volume 0750db9f-b504-4c4e-9180-6e397df13ab6 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:47:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:47:07 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:47:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0750db9f-b504-4c4e-9180-6e397df13ab6 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:07 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0750db9f-b504-4c4e-9180-6e397df13ab6 1073741824 Jul 10 04:47:07 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:07 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-7977d80d-1e89-4463-ae6b-c781c28f2c5a tempest-GroupsV320Test-620958333 None] Group tempest-GroupsV320Test-Group-307964639: creating Jul 10 04:47:07 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-7977d80d-1e89-4463-ae6b-c781c28f2c5a tempest-GroupsV320Test-620958333 None] Group tempest-GroupsV320Test-Group-307964639: created successfully Jul 10 04:47:07 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-7977d80d-1e89-4463-ae6b-c781c28f2c5a tempest-GroupsV320Test-620958333 None] Create group completed successfully. Jul 10 04:47:08 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0750db9f-b504-4c4e-9180-6e397df13ab6 1073741824" returned: 0 in 0.861s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0750db9f-b504-4c4e-9180-6e397df13ab6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:08 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0750db9f-b504-4c4e-9180-6e397df13ab6 Jul 10 04:47:08 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:09 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0750db9f-b504-4c4e-9180-6e397df13ab6" returned: 0 in 0.675s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:47:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f961b1c-ebce-4098-bd76-40a2cad9892c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0750db9f-b504-4c4e-9180-6e397df13ab6', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3e9095-b963-4721-bb76-899aab4a842d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:09 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-3f2d291c-4f8c-4863-aac5-88aeb7e858fd tempest-GroupsV320Test-620958333 None] Created reservations ['eef8d350-a032-41c4-b011-a14469356883'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:47:09 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Volume volume-0750db9f-b504-4c4e-9180-6e397df13ab6 (0750db9f-b504-4c4e-9180-6e397df13ab6): created successfully Jul 10 04:47:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3e9095-b963-4721-bb76-899aab4a842d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Flow 'volume_create_manager' (e8935b12-1df3-48a4-a22c-c59bde245537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:09 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-8d3db48a-1ebd-449d-aa5a-58a86064a7d9 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Created volume successfully. Jul 10 04:47:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3f2d291c-4f8c-4863-aac5-88aeb7e858fd tempest-GroupsV320Test-620958333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3f2d291c-4f8c-4863-aac5-88aeb7e858fd tempest-GroupsV320Test-620958333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3f2d291c-4f8c-4863-aac5-88aeb7e858fd tempest-GroupsV320Test-620958333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3f2d291c-4f8c-4863-aac5-88aeb7e858fd tempest-GroupsV320Test-620958333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3f2d291c-4f8c-4863-aac5-88aeb7e858fd tempest-GroupsV320Test-620958333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3f2d291c-4f8c-4863-aac5-88aeb7e858fd tempest-GroupsV320Test-620958333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:09 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:47:09 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:10 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3f2d291c-4f8c-4863-aac5-88aeb7e858fd tempest-GroupsV320Test-620958333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.810s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-3f2d291c-4f8c-4863-aac5-88aeb7e858fd tempest-GroupsV320Test-620958333 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:47:10 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-3f2d291c-4f8c-4863-aac5-88aeb7e858fd tempest-GroupsV320Test-620958333 None] Delete group completed successfully. Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Flow 'volume_create_manager' (bbdee4bc-1ef5-42b4-8e3f-d34a54b87d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afeb4c7c-9d85-4dc6-8924-b3d04d7c9f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afeb4c7c-9d85-4dc6-8924-b3d04d7c9f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1517870914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95f496812f64cefbfd6cde1cc309de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:10Z,use_quota=True,user_id='4bc049e469594bf8b06529afad35c5d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1981c2-a5d3-4ae2-8189-4dac641db6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1981c2-a5d3-4ae2-8189-4dac641db6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758e3e9d-451f-456d-bbc2-b649b06395cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758e3e9d-451f-456d-bbc2-b649b06395cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1', 'volume_name': 'volume-ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b768c4cd-0b7c-45c9-8b78-2a9b4fbe1b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b768c4cd-0b7c-45c9-8b78-2a9b4fbe1b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (564bd7f1-b645-40d2-8f21-203c8ef90cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:10 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Volume ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1', 'volume_size': 1} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1517870914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95f496812f64cefbfd6cde1cc309de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:10Z,use_quota=True,user_id='4bc049e469594bf8b06529afad35c5d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Creating volume ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:47:10 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:10 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1 1073741824 Jul 10 04:47:10 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Flow 'volume_create_manager' (5684fd95-0f21-45ca-8df4-a2f7b6f558b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c240383-2c4c-4990-abb7-ed6523089e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c240383-2c4c-4990-abb7-ed6523089e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-931305306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=699608e9-369c-401e-be15-8f562d42d5a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95f496812f64cefbfd6cde1cc309de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:11Z,use_quota=True,user_id='4bc049e469594bf8b06529afad35c5d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1077fb02-a10a-4ed7-96de-f8e8513d200a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1077fb02-a10a-4ed7-96de-f8e8513d200a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd34821-fb88-4441-ace4-9f54b837a73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd34821-fb88-4441-ace4-9f54b837a73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '699608e9-369c-401e-be15-8f562d42d5a7', 'volume_name': 'volume-699608e9-369c-401e-be15-8f562d42d5a7', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2a8a4d-4120-48e1-b14b-8819f89a86e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2a8a4d-4120-48e1-b14b-8819f89a86e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19663562-74f9-4fa8-929c-4c20cf04ef81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:10 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Volume 699608e9-369c-401e-be15-8f562d42d5a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-699608e9-369c-401e-be15-8f562d42d5a7', 'volume_size': 1} Jul 10 04:47:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Flow 'volume_create_manager' (3dacbf7a-71e6-494f-961a-724bc4053d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a89f2b-50f8-4d29-9735-9f74af21dd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a89f2b-50f8-4d29-9735-9f74af21dd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2070999685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13cdf4ad-44c8-4256-82b9-46ee9c53e8bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95f496812f64cefbfd6cde1cc309de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:11Z,use_quota=True,user_id='4bc049e469594bf8b06529afad35c5d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de7b71c-0fef-480b-bd66-86dc5d646064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de7b71c-0fef-480b-bd66-86dc5d646064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282f8cc9-bdb1-4612-8f67-fb7e02056499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282f8cc9-bdb1-4612-8f67-fb7e02056499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13cdf4ad-44c8-4256-82b9-46ee9c53e8bf', 'volume_name': 'volume-13cdf4ad-44c8-4256-82b9-46ee9c53e8bf', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb301c88-3160-416a-8a0d-5d35f8ca2254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb301c88-3160-416a-8a0d-5d35f8ca2254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43e6dd4-a26e-4f84-94ff-8d12e255fc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:11 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Volume 13cdf4ad-44c8-4256-82b9-46ee9c53e8bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13cdf4ad-44c8-4256-82b9-46ee9c53e8bf', 'volume_size': 1} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:11 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1 1073741824" returned: 0 in 1.382s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:11 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1 Jul 10 04:47:11 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Flow 'volume_create_manager' (8e24f19c-6e18-4b8e-b7c5-6445eea94bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ac342f-d277-4cd5-88cb-00a9ff5b5cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ac342f-d277-4cd5-88cb-00a9ff5b5cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-493136365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=386a7926-57e8-4ecc-91cd-8cc63147157a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95f496812f64cefbfd6cde1cc309de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:12Z,use_quota=True,user_id='4bc049e469594bf8b06529afad35c5d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e048f687-150e-4b6f-9baa-8074bb3306c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e048f687-150e-4b6f-9baa-8074bb3306c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4b57f9-51f4-4de0-ac81-55564c2da83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4b57f9-51f4-4de0-ac81-55564c2da83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '386a7926-57e8-4ecc-91cd-8cc63147157a', 'volume_name': 'volume-386a7926-57e8-4ecc-91cd-8cc63147157a', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd1e342-0c5e-49fd-a9c6-5435d97bceda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd1e342-0c5e-49fd-a9c6-5435d97bceda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80fd4b1c-72e0-4fe2-a006-a35f6cde5fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:11 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Volume 386a7926-57e8-4ecc-91cd-8cc63147157a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-386a7926-57e8-4ecc-91cd-8cc63147157a', 'volume_size': 1} Jul 10 04:47:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Flow 'volume_create_manager' (45bdfac2-6ea6-407f-b8eb-b9d7262128df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499be0df-ec70-4930-8949-a2eefcf0c224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499be0df-ec70-4930-8949-a2eefcf0c224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1205604270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95f496812f64cefbfd6cde1cc309de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:12Z,use_quota=True,user_id='4bc049e469594bf8b06529afad35c5d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09cd66b7-7e25-4fd2-b288-46762f624502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09cd66b7-7e25-4fd2-b288-46762f624502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06688199-a877-4c97-a455-9d3029607add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06688199-a877-4c97-a455-9d3029607add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2', 'volume_name': 'volume-c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51afa685-fb79-4316-9e30-94b46b809e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51afa685-fb79-4316-9e30-94b46b809e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9829a9f-3c79-4f34-af5b-61715aea0607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:12 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Volume c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2', 'volume_size': 1} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:12 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1" returned: 0 in 0.902s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] <== create_volume: return (2379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.382s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.688s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-931305306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=699608e9-369c-401e-be15-8f562d42d5a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95f496812f64cefbfd6cde1cc309de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:11Z,use_quota=True,user_id='4bc049e469594bf8b06529afad35c5d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Creating volume 699608e9-369c-401e-be15-8f562d42d5a7 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:47:12 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-699608e9-369c-401e-be15-8f562d42d5a7 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:12 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-699608e9-369c-401e-be15-8f562d42d5a7 1073741824 Jul 10 04:47:12 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (564bd7f1-b645-40d2-8f21-203c8ef90cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e85264d-98df-40fd-8293-b9cad4bae26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:12 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Volume volume-ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1 (ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1): created successfully Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e85264d-98df-40fd-8293-b9cad4bae26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Flow 'volume_create_manager' (bbdee4bc-1ef5-42b4-8e3f-d34a54b87d75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:12 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-2496a47c-58ab-456e-8e84-b1f393fa7863 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Created volume successfully. Jul 10 04:47:13 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-699608e9-369c-401e-be15-8f562d42d5a7 1073741824" returned: 0 in 0.918s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-699608e9-369c-401e-be15-8f562d42d5a7 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:13 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-699608e9-369c-401e-be15-8f562d42d5a7 Jul 10 04:47:13 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:14 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-699608e9-369c-401e-be15-8f562d42d5a7" returned: 0 in 0.723s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.846s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2070999685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13cdf4ad-44c8-4256-82b9-46ee9c53e8bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95f496812f64cefbfd6cde1cc309de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:11Z,use_quota=True,user_id='4bc049e469594bf8b06529afad35c5d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Creating volume 13cdf4ad-44c8-4256-82b9-46ee9c53e8bf {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:47:14 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-13cdf4ad-44c8-4256-82b9-46ee9c53e8bf 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19663562-74f9-4fa8-929c-4c20cf04ef81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-699608e9-369c-401e-be15-8f562d42d5a7', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:14 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-13cdf4ad-44c8-4256-82b9-46ee9c53e8bf 1073741824 Jul 10 04:47:14 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbcaa75e-202c-4154-b104-84cab102c86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:14 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Volume volume-699608e9-369c-401e-be15-8f562d42d5a7 (699608e9-369c-401e-be15-8f562d42d5a7): created successfully Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbcaa75e-202c-4154-b104-84cab102c86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Flow 'volume_create_manager' (5684fd95-0f21-45ca-8df4-a2f7b6f558b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:14 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-836b0627-1d77-4956-8b5f-7d3303aa22da tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Created volume successfully. Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Flow 'volume_create_manager' (b7783e29-a254-4a09-a253-37ce36b05276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa1e570-c289-459c-9a41-2c9811bd466c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa1e570-c289-459c-9a41-2c9811bd466c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-750523400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e541f69d-5df3-4a7d-b22c-b24572ef4857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fd2a4bb0d2c4c278263871d825c95de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:15Z,use_quota=True,user_id='1141098bdca34b6fa533e93d4717d010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0760a370-8092-4dd2-a55c-5798d3c9e70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0760a370-8092-4dd2-a55c-5798d3c9e70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc5a698d-5496-4038-ba19-5d27d6d4e1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc5a698d-5496-4038-ba19-5d27d6d4e1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e541f69d-5df3-4a7d-b22c-b24572ef4857', 'volume_name': 'volume-e541f69d-5df3-4a7d-b22c-b24572ef4857', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e960a89-a34c-4316-9cca-b83830c6604b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e960a89-a34c-4316-9cca-b83830c6604b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4255efd-3ae8-4e7e-a5a5-38d610803631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:14 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Volume e541f69d-5df3-4a7d-b22c-b24572ef4857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e541f69d-5df3-4a7d-b22c-b24572ef4857', 'volume_size': 1} Jul 10 04:47:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:15 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-13cdf4ad-44c8-4256-82b9-46ee9c53e8bf 1073741824" returned: 0 in 1.029s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-13cdf4ad-44c8-4256-82b9-46ee9c53e8bf {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:15 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-13cdf4ad-44c8-4256-82b9-46ee9c53e8bf Jul 10 04:47:15 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:47:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:15 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:47:15 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:15 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-13cdf4ad-44c8-4256-82b9-46ee9c53e8bf" returned: 0 in 0.630s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:47:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.147s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-493136365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=386a7926-57e8-4ecc-91cd-8cc63147157a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95f496812f64cefbfd6cde1cc309de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:12Z,use_quota=True,user_id='4bc049e469594bf8b06529afad35c5d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:47:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Creating volume 386a7926-57e8-4ecc-91cd-8cc63147157a {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:47:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:47:15 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:47:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-386a7926-57e8-4ecc-91cd-8cc63147157a 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43e6dd4-a26e-4f84-94ff-8d12e255fc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13cdf4ad-44c8-4256-82b9-46ee9c53e8bf', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e95c99-8ebb-4e6d-a439-3f35f7d867f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:16 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-386a7926-57e8-4ecc-91cd-8cc63147157a 1073741824 Jul 10 04:47:16 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:16 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Volume volume-13cdf4ad-44c8-4256-82b9-46ee9c53e8bf (13cdf4ad-44c8-4256-82b9-46ee9c53e8bf): created successfully Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e95c99-8ebb-4e6d-a439-3f35f7d867f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Flow 'volume_create_manager' (3dacbf7a-71e6-494f-961a-724bc4053d55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:16 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-9fbe4644-14a7-4c5d-a1b9-dd44045b9904 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Created volume successfully. Jul 10 04:47:16 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.728s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Flow 'volume_create_manager' (525efd80-0f45-44c2-a27c-17c04eced1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161831c0-502c-4fce-9a1e-0e23f808836e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161831c0-502c-4fce-9a1e-0e23f808836e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2092648262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307de802-3cca-4a4c-8276-721a04bd2774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55d4b9ce9e82404198de59e72b32e3ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:17Z,use_quota=True,user_id='41ec005981ca4a778427ba36274c42a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b26863-2b35-4e8a-b7de-576d61b5cf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b26863-2b35-4e8a-b7de-576d61b5cf1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd747731-4f04-4bb5-8d97-b292df524b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd747731-4f04-4bb5-8d97-b292df524b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '307de802-3cca-4a4c-8276-721a04bd2774', 'volume_name': 'volume-307de802-3cca-4a4c-8276-721a04bd2774', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a68cf08-dfb8-4062-8548-bc84f048351a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a68cf08-dfb8-4062-8548-bc84f048351a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c19633-1573-4a0c-ac0c-a89b746e70ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:16 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Volume 307de802-3cca-4a4c-8276-721a04bd2774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-307de802-3cca-4a4c-8276-721a04bd2774', 'volume_size': 1} Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:16 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-386a7926-57e8-4ecc-91cd-8cc63147157a 1073741824" returned: 0 in 0.965s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-386a7926-57e8-4ecc-91cd-8cc63147157a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:17 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-386a7926-57e8-4ecc-91cd-8cc63147157a Jul 10 04:47:17 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:17 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-386a7926-57e8-4ecc-91cd-8cc63147157a" returned: 0 in 0.643s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:47:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.237s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1205604270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95f496812f64cefbfd6cde1cc309de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:12Z,use_quota=True,user_id='4bc049e469594bf8b06529afad35c5d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:47:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Creating volume c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:47:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:47:17 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:47:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:17 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2 1073741824 Jul 10 04:47:17 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80fd4b1c-72e0-4fe2-a006-a35f6cde5fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-386a7926-57e8-4ecc-91cd-8cc63147157a', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7faa4889-99c9-40bd-bedd-6605ed5158a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:17 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Volume volume-386a7926-57e8-4ecc-91cd-8cc63147157a (386a7926-57e8-4ecc-91cd-8cc63147157a): created successfully Jul 10 04:47:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7faa4889-99c9-40bd-bedd-6605ed5158a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Flow 'volume_create_manager' (8e24f19c-6e18-4b8e-b7c5-6445eea94bf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:17 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-3f4bfe36-f84f-4683-b5cc-e0e13983abe3 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Created volume successfully. Jul 10 04:47:18 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2 1073741824" returned: 0 in 0.838s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:18 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2 Jul 10 04:47:18 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:19 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2" returned: 0 in 0.662s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:47:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.282s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-750523400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e541f69d-5df3-4a7d-b22c-b24572ef4857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fd2a4bb0d2c4c278263871d825c95de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:15Z,use_quota=True,user_id='1141098bdca34b6fa533e93d4717d010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:47:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Creating volume e541f69d-5df3-4a7d-b22c-b24572ef4857 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:47:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:47:19 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:47:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e541f69d-5df3-4a7d-b22c-b24572ef4857 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:19 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e541f69d-5df3-4a7d-b22c-b24572ef4857 1073741824 Jul 10 04:47:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9829a9f-3c79-4f34-af5b-61715aea0607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:19 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcce9486-c012-428c-b5a4-e4cf4762d474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:19 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Volume volume-c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2 (c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2): created successfully Jul 10 04:47:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcce9486-c012-428c-b5a4-e4cf4762d474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Flow 'volume_create_manager' (45bdfac2-6ea6-407f-b8eb-b9d7262128df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:19 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-5b0a2550-4173-4282-888d-41fdd5888160 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Created volume successfully. Jul 10 04:47:20 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e541f69d-5df3-4a7d-b22c-b24572ef4857 1073741824" returned: 0 in 0.822s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e541f69d-5df3-4a7d-b22c-b24572ef4857 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-51775719-cb3f-45fc-b974-f76dd5a21437 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "cinder-c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:20 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e541f69d-5df3-4a7d-b22c-b24572ef4857 Jul 10 04:47:20 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-51775719-cb3f-45fc-b974-f76dd5a21437 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-51775719-cb3f-45fc-b974-f76dd5a21437 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "cinder-quobyte-c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-51775719-cb3f-45fc-b974-f76dd5a21437 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-quobyte-c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2" acquired by "delete_volume" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1c5985-8c4b-433e-8267-0a7f5c814840]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-51775719-cb3f-45fc-b974-f76dd5a21437 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:20 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2 Jul 10 04:47:20 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:20 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e541f69d-5df3-4a7d-b22c-b24572ef4857" returned: 0 in 0.656s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.813s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2092648262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307de802-3cca-4a4c-8276-721a04bd2774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55d4b9ce9e82404198de59e72b32e3ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:17Z,use_quota=True,user_id='41ec005981ca4a778427ba36274c42a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Creating volume 307de802-3cca-4a4c-8276-721a04bd2774 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:47:20 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:20 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774 1073741824 Jul 10 04:47:20 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4255efd-3ae8-4e7e-a5a5-38d610803631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e541f69d-5df3-4a7d-b22c-b24572ef4857', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38a05c5-d4f1-4b77-99fc-ed298a125d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:20 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Volume volume-e541f69d-5df3-4a7d-b22c-b24572ef4857 (e541f69d-5df3-4a7d-b22c-b24572ef4857): created successfully Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38a05c5-d4f1-4b77-99fc-ed298a125d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Flow 'volume_create_manager' (b7783e29-a254-4a09-a253-37ce36b05276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:20 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a5bd85c5-c96c-4e5d-9fe3-6f369a8f3150 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Created volume successfully. Jul 10 04:47:20 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-51775719-cb3f-45fc-b974-f76dd5a21437 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2" returned: 0 in 0.781s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-51775719-cb3f-45fc-b974-f76dd5a21437 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:20 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2 Jul 10 04:47:20 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:21 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774 1073741824" returned: 0 in 0.884s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:21 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-51775719-cb3f-45fc-b974-f76dd5a21437 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2" returned: 0 in 0.683s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:21 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774 Jul 10 04:47:21 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-51775719-cb3f-45fc-b974-f76dd5a21437 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-quobyte-c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2" released by "delete_volume" :: held 1.507s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:21 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:21 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-51775719-cb3f-45fc-b974-f76dd5a21437 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Created reservations ['04844b30-96e9-4098-a4ae-d940c205b9e0', 'a4f8225e-e2b9-4569-b9a6-8c192af53741', '9e442850-a1e9-4351-b7ba-2dd4bd235003', 'a3fbaab4-f295-4398-b2d1-713436e55341'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:47:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-51775719-cb3f-45fc-b974-f76dd5a21437 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-51775719-cb3f-45fc-b974-f76dd5a21437 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-51775719-cb3f-45fc-b974-f76dd5a21437 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-51775719-cb3f-45fc-b974-f76dd5a21437 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-51775719-cb3f-45fc-b974-f76dd5a21437 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-51775719-cb3f-45fc-b974-f76dd5a21437 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:21 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:47:21 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:22 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774" returned: 0 in 0.648s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:47:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-4754591e-b533-4df7-acda-606a227c09c8 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "cinder-386a7926-57e8-4ecc-91cd-8cc63147157a-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c19633-1573-4a0c-ac0c-a89b746e70ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-307de802-3cca-4a4c-8276-721a04bd2774', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33037b4-1898-4737-a741-fc8f43bc5ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-4754591e-b533-4df7-acda-606a227c09c8 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-386a7926-57e8-4ecc-91cd-8cc63147157a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:22 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Volume volume-307de802-3cca-4a4c-8276-721a04bd2774 (307de802-3cca-4a4c-8276-721a04bd2774): created successfully Jul 10 04:47:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33037b4-1898-4737-a741-fc8f43bc5ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Flow 'volume_create_manager' (525efd80-0f45-44c2-a27c-17c04eced1be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:22 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d36b7329-dfd0-4789-adec-a476648b549e tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Created volume successfully. Jul 10 04:47:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-4754591e-b533-4df7-acda-606a227c09c8 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "cinder-quobyte-386a7926-57e8-4ecc-91cd-8cc63147157a" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-4754591e-b533-4df7-acda-606a227c09c8 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-quobyte-386a7926-57e8-4ecc-91cd-8cc63147157a" acquired by "delete_volume" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:22 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67c7d87-d5fc-42b9-8cf7-9081eb78de31]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4754591e-b533-4df7-acda-606a227c09c8 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-386a7926-57e8-4ecc-91cd-8cc63147157a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:22 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-51775719-cb3f-45fc-b974-f76dd5a21437 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.688s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:22 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-51775719-cb3f-45fc-b974-f76dd5a21437 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:47:22 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-51775719-cb3f-45fc-b974-f76dd5a21437 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Deleted volume successfully. Jul 10 04:47:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-51775719-cb3f-45fc-b974-f76dd5a21437 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-c5a4095f-33bf-4e49-a305-2e4ab9dfe1e2-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:22 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-386a7926-57e8-4ecc-91cd-8cc63147157a Jul 10 04:47:22 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:23 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4754591e-b533-4df7-acda-606a227c09c8 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-386a7926-57e8-4ecc-91cd-8cc63147157a" returned: 0 in 0.826s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4754591e-b533-4df7-acda-606a227c09c8 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-386a7926-57e8-4ecc-91cd-8cc63147157a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-82577dc1-90cb-4cf7-8954-047686392cb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-82577dc1-90cb-4cf7-8954-047686392cb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:23 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-386a7926-57e8-4ecc-91cd-8cc63147157a Jul 10 04:47:23 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:23 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-82577dc1-90cb-4cf7-8954-047686392cb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Creating offline snapshot 4c06681f-0d29-43f0-a32d-31f0035c19c1 of volume 307de802-3cca-4a4c-8276-721a04bd2774 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:47:23 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26521c2-884a-493e-8eb2-60dd733e04d8]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-82577dc1-90cb-4cf7-8954-047686392cb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:23 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774 Jul 10 04:47:23 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:23 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4754591e-b533-4df7-acda-606a227c09c8 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-386a7926-57e8-4ecc-91cd-8cc63147157a" returned: 0 in 0.717s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-4754591e-b533-4df7-acda-606a227c09c8 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-quobyte-386a7926-57e8-4ecc-91cd-8cc63147157a" released by "delete_volume" :: held 1.598s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:24 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-4754591e-b533-4df7-acda-606a227c09c8 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Created reservations ['bc5ddce3-4b11-41e5-a4b3-9ef6114c6677', 'a31df6d3-5db0-48c0-80e6-d3c19733271c', '9aae555e-e676-4234-b1bb-655e87d3290e', 'c665ad29-5b72-42d9-8c43-8f13245188da'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:47:24 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4754591e-b533-4df7-acda-606a227c09c8 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4754591e-b533-4df7-acda-606a227c09c8 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4754591e-b533-4df7-acda-606a227c09c8 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4754591e-b533-4df7-acda-606a227c09c8 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4754591e-b533-4df7-acda-606a227c09c8 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4754591e-b533-4df7-acda-606a227c09c8 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-82577dc1-90cb-4cf7-8954-047686392cb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774" returned: 0 in 0.833s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-82577dc1-90cb-4cf7-8954-047686392cb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.4c06681f-0d29-43f0-a32d-31f0035c19c1 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:24 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:47:24 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:24 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.4c06681f-0d29-43f0-a32d-31f0035c19c1 1G Jul 10 04:47:24 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-07f938db-0cf3-440f-98e6-b6e55155c901 req-ceeb331d-cd70-43de-a806-6c417e279d75 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-390d943a-04ad-4bdb-ad91-5fa970aaeb93 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "cinder-13cdf4ad-44c8-4256-82b9-46ee9c53e8bf-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-390d943a-04ad-4bdb-ad91-5fa970aaeb93 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-13cdf4ad-44c8-4256-82b9-46ee9c53e8bf-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-390d943a-04ad-4bdb-ad91-5fa970aaeb93 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "cinder-quobyte-13cdf4ad-44c8-4256-82b9-46ee9c53e8bf" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-390d943a-04ad-4bdb-ad91-5fa970aaeb93 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-quobyte-13cdf4ad-44c8-4256-82b9-46ee9c53e8bf" acquired by "delete_volume" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:24 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4f421b-a057-4067-92b4-b7256ffffd2f]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-390d943a-04ad-4bdb-ad91-5fa970aaeb93 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-13cdf4ad-44c8-4256-82b9-46ee9c53e8bf {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:24 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-13cdf4ad-44c8-4256-82b9-46ee9c53e8bf Jul 10 04:47:24 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:24 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4754591e-b533-4df7-acda-606a227c09c8 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.671s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:24 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-4754591e-b533-4df7-acda-606a227c09c8 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:47:24 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-4754591e-b533-4df7-acda-606a227c09c8 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Deleted volume successfully. Jul 10 04:47:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-4754591e-b533-4df7-acda-606a227c09c8 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-386a7926-57e8-4ecc-91cd-8cc63147157a-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:25 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-82577dc1-90cb-4cf7-8954-047686392cb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.4c06681f-0d29-43f0-a32d-31f0035c19c1 1G" returned: 0 in 0.868s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-82577dc1-90cb-4cf7-8954-047686392cb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-307de802-3cca-4a4c-8276-721a04bd2774 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.4c06681f-0d29-43f0-a32d-31f0035c19c1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:25 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-307de802-3cca-4a4c-8276-721a04bd2774 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.4c06681f-0d29-43f0-a32d-31f0035c19c1 Jul 10 04:47:25 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:25 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-390d943a-04ad-4bdb-ad91-5fa970aaeb93 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-13cdf4ad-44c8-4256-82b9-46ee9c53e8bf" returned: 0 in 0.826s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-390d943a-04ad-4bdb-ad91-5fa970aaeb93 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-13cdf4ad-44c8-4256-82b9-46ee9c53e8bf {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:25 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-13cdf4ad-44c8-4256-82b9-46ee9c53e8bf Jul 10 04:47:25 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:25 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-82577dc1-90cb-4cf7-8954-047686392cb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-307de802-3cca-4a4c-8276-721a04bd2774 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.4c06681f-0d29-43f0-a32d-31f0035c19c1" returned: 0 in 0.696s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:25 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-82577dc1-90cb-4cf7-8954-047686392cb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.4c06681f-0d29-43f0-a32d-31f0035c19c1 is being set with open permissions: ugo+rw Jul 10 04:47:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-82577dc1-90cb-4cf7-8954-047686392cb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.4c06681f-0d29-43f0-a32d-31f0035c19c1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:25 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.4c06681f-0d29-43f0-a32d-31f0035c19c1 Jul 10 04:47:25 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:26 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-390d943a-04ad-4bdb-ad91-5fa970aaeb93 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-13cdf4ad-44c8-4256-82b9-46ee9c53e8bf" returned: 0 in 0.692s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:26 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-390d943a-04ad-4bdb-ad91-5fa970aaeb93 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-quobyte-13cdf4ad-44c8-4256-82b9-46ee9c53e8bf" released by "delete_volume" :: held 1.558s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:26 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-390d943a-04ad-4bdb-ad91-5fa970aaeb93 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Created reservations ['387a634a-45e0-4733-aec3-6f890a001ffc', '38ca2a1c-e87f-4b7c-8312-c9ce94f2eefe', '7edf2ed1-0b8b-48ea-a4a2-a00628c386d2', '1c78cd4c-316d-48ac-85a2-142ef3a51f70'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:47:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-390d943a-04ad-4bdb-ad91-5fa970aaeb93 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-390d943a-04ad-4bdb-ad91-5fa970aaeb93 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-390d943a-04ad-4bdb-ad91-5fa970aaeb93 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-390d943a-04ad-4bdb-ad91-5fa970aaeb93 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-390d943a-04ad-4bdb-ad91-5fa970aaeb93 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-390d943a-04ad-4bdb-ad91-5fa970aaeb93 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:26 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:47:26 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:26 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-82577dc1-90cb-4cf7-8954-047686392cb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.4c06681f-0d29-43f0-a32d-31f0035c19c1" returned: 0 in 0.669s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-82577dc1-90cb-4cf7-8954-047686392cb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:26 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.info Jul 10 04:47:26 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:26 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9b4119aa-0c2c-41bb-aa5c-f79b9bd957ec tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "cinder-699608e9-369c-401e-be15-8f562d42d5a7-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:26 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9b4119aa-0c2c-41bb-aa5c-f79b9bd957ec tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-699608e9-369c-401e-be15-8f562d42d5a7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:26 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9b4119aa-0c2c-41bb-aa5c-f79b9bd957ec tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "cinder-quobyte-699608e9-369c-401e-be15-8f562d42d5a7" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:26 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9b4119aa-0c2c-41bb-aa5c-f79b9bd957ec tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-quobyte-699608e9-369c-401e-be15-8f562d42d5a7" acquired by "delete_volume" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:26 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[968d6646-6f02-4630-8987-b12617881f60]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9b4119aa-0c2c-41bb-aa5c-f79b9bd957ec tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-699608e9-369c-401e-be15-8f562d42d5a7 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:27 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-699608e9-369c-401e-be15-8f562d42d5a7 Jul 10 04:47:27 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:27 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-390d943a-04ad-4bdb-ad91-5fa970aaeb93 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.726s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:27 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-390d943a-04ad-4bdb-ad91-5fa970aaeb93 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:47:27 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-390d943a-04ad-4bdb-ad91-5fa970aaeb93 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Deleted volume successfully. Jul 10 04:47:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-390d943a-04ad-4bdb-ad91-5fa970aaeb93 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-13cdf4ad-44c8-4256-82b9-46ee9c53e8bf-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:27 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-82577dc1-90cb-4cf7-8954-047686392cb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.info" returned: 0 in 0.683s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:27 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-82577dc1-90cb-4cf7-8954-047686392cb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.info is being set with open permissions: ugo+rw Jul 10 04:47:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-82577dc1-90cb-4cf7-8954-047686392cb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:27 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.info Jul 10 04:47:27 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:27 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9b4119aa-0c2c-41bb-aa5c-f79b9bd957ec tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-699608e9-369c-401e-be15-8f562d42d5a7" returned: 0 in 0.768s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9b4119aa-0c2c-41bb-aa5c-f79b9bd957ec tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-699608e9-369c-401e-be15-8f562d42d5a7 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:27 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-699608e9-369c-401e-be15-8f562d42d5a7 Jul 10 04:47:27 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:27 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-82577dc1-90cb-4cf7-8954-047686392cb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.info" returned: 0 in 0.669s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-82577dc1-90cb-4cf7-8954-047686392cb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.521s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-07f938db-0cf3-440f-98e6-b6e55155c901 req-ceeb331d-cd70-43de-a806-6c417e279d75 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.516s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:27 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a968c22-39e3-4fc6-9e3b-c049eaffc351]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-07f938db-0cf3-440f-98e6-b6e55155c901 req-ceeb331d-cd70-43de-a806-6c417e279d75 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e541f69d-5df3-4a7d-b22c-b24572ef4857 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:27 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-82577dc1-90cb-4cf7-8954-047686392cb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Create snapshot completed successfully Jul 10 04:47:27 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e541f69d-5df3-4a7d-b22c-b24572ef4857 Jul 10 04:47:27 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:28 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9b4119aa-0c2c-41bb-aa5c-f79b9bd957ec tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-699608e9-369c-401e-be15-8f562d42d5a7" returned: 0 in 0.698s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9b4119aa-0c2c-41bb-aa5c-f79b9bd957ec tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-quobyte-699608e9-369c-401e-be15-8f562d42d5a7" released by "delete_volume" :: held 1.517s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:28 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-9b4119aa-0c2c-41bb-aa5c-f79b9bd957ec tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Created reservations ['88cfe2ab-1f67-4a55-8afd-2fd78e2c63a0', '409af081-0eb1-4740-9370-59e1e9fb4eda', '83c72425-a384-4891-8f99-42dc38253588', '5fd7e470-db04-4a98-8b70-90a8e0374088'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:47:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9b4119aa-0c2c-41bb-aa5c-f79b9bd957ec tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9b4119aa-0c2c-41bb-aa5c-f79b9bd957ec tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9b4119aa-0c2c-41bb-aa5c-f79b9bd957ec tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9b4119aa-0c2c-41bb-aa5c-f79b9bd957ec tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9b4119aa-0c2c-41bb-aa5c-f79b9bd957ec tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9b4119aa-0c2c-41bb-aa5c-f79b9bd957ec tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:28 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:47:28 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:28 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-07f938db-0cf3-440f-98e6-b6e55155c901 req-ceeb331d-cd70-43de-a806-6c417e279d75 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e541f69d-5df3-4a7d-b22c-b24572ef4857" returned: 0 in 0.805s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-07f938db-0cf3-440f-98e6-b6e55155c901 req-ceeb331d-cd70-43de-a806-6c417e279d75 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.828s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-07f938db-0cf3-440f-98e6-b6e55155c901 req-ceeb331d-cd70-43de-a806-6c417e279d75 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31', 'name': 'volume-e541f69d-5df3-4a7d-b22c-b24572ef4857', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '532b5460-3fb5-4d7c-af72-526acb4bb26e', 'enforce_multipath': True} {{(pid=87359) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4975}} Jul 10 04:47:28 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-07f938db-0cf3-440f-98e6-b6e55155c901 req-ceeb331d-cd70-43de-a806-6c417e279d75 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] attachment_update completed successfully. Jul 10 04:47:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8edbfc11-e15f-495a-babc-c44ea26f9406 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Acquiring lock "cinder-4c06681f-0d29-43f0-a32d-31f0035c19c1-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8edbfc11-e15f-495a-babc-c44ea26f9406 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Lock "cinder-4c06681f-0d29-43f0-a32d-31f0035c19c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8edbfc11-e15f-495a-babc-c44ea26f9406 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Acquiring lock "cinder-quobyte-307de802-3cca-4a4c-8276-721a04bd2774" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6b32aac1-46f2-497b-9954-b6ba2377a448 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "cinder-ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8edbfc11-e15f-495a-babc-c44ea26f9406 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Lock "cinder-quobyte-307de802-3cca-4a4c-8276-721a04bd2774" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8edbfc11-e15f-495a-babc-c44ea26f9406 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Acquiring lock "cinder-quobyte-4c06681f-0d29-43f0-a32d-31f0035c19c1" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6b32aac1-46f2-497b-9954-b6ba2377a448 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8edbfc11-e15f-495a-babc-c44ea26f9406 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Lock "cinder-quobyte-4c06681f-0d29-43f0-a32d-31f0035c19c1" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-8edbfc11-e15f-495a-babc-c44ea26f9406 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Deleting offline snapshot 4c06681f-0d29-43f0-a32d-31f0035c19c1 of volume 307de802-3cca-4a4c-8276-721a04bd2774 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:47:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-8edbfc11-e15f-495a-babc-c44ea26f9406 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] snapshot_file for this snap is: volume-307de802-3cca-4a4c-8276-721a04bd2774.4c06681f-0d29-43f0-a32d-31f0035c19c1 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:47:29 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[72990952-665d-49de-97a9-0b87c385392c]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8edbfc11-e15f-495a-babc-c44ea26f9406 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.4c06681f-0d29-43f0-a32d-31f0035c19c1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6b32aac1-46f2-497b-9954-b6ba2377a448 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "cinder-quobyte-ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6b32aac1-46f2-497b-9954-b6ba2377a448 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-quobyte-ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1" acquired by "delete_volume" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:29 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d399317-0056-4d16-9c9c-bbc472650713]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6b32aac1-46f2-497b-9954-b6ba2377a448 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:29 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.4c06681f-0d29-43f0-a32d-31f0035c19c1 Jul 10 04:47:29 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:29 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9b4119aa-0c2c-41bb-aa5c-f79b9bd957ec tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.822s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:29 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-9b4119aa-0c2c-41bb-aa5c-f79b9bd957ec tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:47:29 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-9b4119aa-0c2c-41bb-aa5c-f79b9bd957ec tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Deleted volume successfully. Jul 10 04:47:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9b4119aa-0c2c-41bb-aa5c-f79b9bd957ec tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-699608e9-369c-401e-be15-8f562d42d5a7-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:29 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1 Jul 10 04:47:29 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:30 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8edbfc11-e15f-495a-babc-c44ea26f9406 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.4c06681f-0d29-43f0-a32d-31f0035c19c1" returned: 0 in 0.864s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:30 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-8edbfc11-e15f-495a-babc-c44ea26f9406 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-307de802-3cca-4a4c-8276-721a04bd2774(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:47:30 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9866e72-82b0-4596-819e-82872e1131fd]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8edbfc11-e15f-495a-babc-c44ea26f9406 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:30 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6b32aac1-46f2-497b-9954-b6ba2377a448 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1" returned: 0 in 0.839s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6b32aac1-46f2-497b-9954-b6ba2377a448 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:30 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1 Jul 10 04:47:30 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:30 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774 Jul 10 04:47:30 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:30 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6b32aac1-46f2-497b-9954-b6ba2377a448 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1" returned: 0 in 0.663s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6b32aac1-46f2-497b-9954-b6ba2377a448 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-quobyte-ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1" released by "delete_volume" :: held 1.560s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:30 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8edbfc11-e15f-495a-babc-c44ea26f9406 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774" returned: 0 in 0.793s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8edbfc11-e15f-495a-babc-c44ea26f9406 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.4c06681f-0d29-43f0-a32d-31f0035c19c1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:30 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.4c06681f-0d29-43f0-a32d-31f0035c19c1 Jul 10 04:47:30 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:30 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-6b32aac1-46f2-497b-9954-b6ba2377a448 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Created reservations ['ddcc549e-2dfa-4876-9154-54fad581202f', '189a81a3-2880-4e61-bafd-67a6460006de', 'abb8953d-8039-4c14-b724-6b199ff84992', '05fd3046-460f-4952-931c-d5d8be8d2967'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:47:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6b32aac1-46f2-497b-9954-b6ba2377a448 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6b32aac1-46f2-497b-9954-b6ba2377a448 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:31 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6b32aac1-46f2-497b-9954-b6ba2377a448 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:31 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6b32aac1-46f2-497b-9954-b6ba2377a448 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6b32aac1-46f2-497b-9954-b6ba2377a448 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6b32aac1-46f2-497b-9954-b6ba2377a448 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:31 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:47:31 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:31 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b606de9f-258b-4ac5-ab96-ac1e5e61d3a7 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "cinder-0750db9f-b504-4c4e-9180-6e397df13ab6-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:31 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b606de9f-258b-4ac5-ab96-ac1e5e61d3a7 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-0750db9f-b504-4c4e-9180-6e397df13ab6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:31 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b606de9f-258b-4ac5-ab96-ac1e5e61d3a7 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "cinder-quobyte-0750db9f-b504-4c4e-9180-6e397df13ab6" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:31 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b606de9f-258b-4ac5-ab96-ac1e5e61d3a7 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-quobyte-0750db9f-b504-4c4e-9180-6e397df13ab6" acquired by "delete_volume" :: waited 0.027s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:31 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[27838bc5-3766-4798-a142-3cd8dde5d2c6]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b606de9f-258b-4ac5-ab96-ac1e5e61d3a7 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0750db9f-b504-4c4e-9180-6e397df13ab6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:31 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0750db9f-b504-4c4e-9180-6e397df13ab6 Jul 10 04:47:31 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:31 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6b32aac1-46f2-497b-9954-b6ba2377a448 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.671s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:31 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-6b32aac1-46f2-497b-9954-b6ba2377a448 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:47:31 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-6b32aac1-46f2-497b-9954-b6ba2377a448 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Deleted volume successfully. Jul 10 04:47:31 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6b32aac1-46f2-497b-9954-b6ba2377a448 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-ea5fbe58-bcd9-4539-8e91-3affb2ba4ba1-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:31 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8edbfc11-e15f-495a-babc-c44ea26f9406 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.4c06681f-0d29-43f0-a32d-31f0035c19c1" returned: 0 in 0.857s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8edbfc11-e15f-495a-babc-c44ea26f9406 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.4c06681f-0d29-43f0-a32d-31f0035c19c1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:31 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.4c06681f-0d29-43f0-a32d-31f0035c19c1 Jul 10 04:47:31 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:32 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b606de9f-258b-4ac5-ab96-ac1e5e61d3a7 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0750db9f-b504-4c4e-9180-6e397df13ab6" returned: 0 in 0.829s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b606de9f-258b-4ac5-ab96-ac1e5e61d3a7 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0750db9f-b504-4c4e-9180-6e397df13ab6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:32 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0750db9f-b504-4c4e-9180-6e397df13ab6 Jul 10 04:47:32 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:32 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8edbfc11-e15f-495a-babc-c44ea26f9406 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774.4c06681f-0d29-43f0-a32d-31f0035c19c1" returned: 0 in 0.660s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8edbfc11-e15f-495a-babc-c44ea26f9406 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Lock "cinder-quobyte-4c06681f-0d29-43f0-a32d-31f0035c19c1" released by "_delete_snapshot" :: held 3.352s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8edbfc11-e15f-495a-babc-c44ea26f9406 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Lock "cinder-quobyte-307de802-3cca-4a4c-8276-721a04bd2774" released by "delete_snapshot" :: held 3.408s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:32 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-8edbfc11-e15f-495a-babc-c44ea26f9406 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Created reservations ['34f0a308-5596-4c53-9cd4-e46387b89161', '41d02ca7-531c-40c6-a552-3156e413a1ff', '8e374825-a662-48c9-a8fc-988dda017279', '54082a9b-0d84-43fe-8f6c-c07bf037b7a9'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:47:32 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-8edbfc11-e15f-495a-babc-c44ea26f9406 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Delete snapshot completed successfully. Jul 10 04:47:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8edbfc11-e15f-495a-babc-c44ea26f9406 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Lock "cinder-4c06681f-0d29-43f0-a32d-31f0035c19c1-delete_snapshot" released by "delete_snapshot" :: held 3.593s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:32 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b606de9f-258b-4ac5-ab96-ac1e5e61d3a7 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0750db9f-b504-4c4e-9180-6e397df13ab6" returned: 0 in 0.666s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b606de9f-258b-4ac5-ab96-ac1e5e61d3a7 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-quobyte-0750db9f-b504-4c4e-9180-6e397df13ab6" released by "delete_volume" :: held 1.558s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:33 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-b606de9f-258b-4ac5-ab96-ac1e5e61d3a7 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Created reservations ['b09ac09b-83da-4838-a81f-b41471382e9a', '725a048d-a43c-456d-a945-34c734b60c0e', '40259529-2707-452d-a89d-66ae36756643', '9d282f7e-0d85-46c3-bced-2b71fb40b6ac'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:47:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b606de9f-258b-4ac5-ab96-ac1e5e61d3a7 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b606de9f-258b-4ac5-ab96-ac1e5e61d3a7 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-b606de9f-258b-4ac5-ab96-ac1e5e61d3a7 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-b606de9f-258b-4ac5-ab96-ac1e5e61d3a7 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b606de9f-258b-4ac5-ab96-ac1e5e61d3a7 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b606de9f-258b-4ac5-ab96-ac1e5e61d3a7 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:33 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:47:33 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cedf5edc-5f0f-49f4-8419-832d2214a244 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Acquiring lock "cinder-307de802-3cca-4a4c-8276-721a04bd2774-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cedf5edc-5f0f-49f4-8419-832d2214a244 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Lock "cinder-307de802-3cca-4a4c-8276-721a04bd2774-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cedf5edc-5f0f-49f4-8419-832d2214a244 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Acquiring lock "cinder-quobyte-307de802-3cca-4a4c-8276-721a04bd2774" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cedf5edc-5f0f-49f4-8419-832d2214a244 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Lock "cinder-quobyte-307de802-3cca-4a4c-8276-721a04bd2774" acquired by "delete_volume" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:33 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ca2e89-b705-4ab5-ac8a-5edfce79cab8]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cedf5edc-5f0f-49f4-8419-832d2214a244 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:33 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774 Jul 10 04:47:33 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:33 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b606de9f-258b-4ac5-ab96-ac1e5e61d3a7 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.800s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:33 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-b606de9f-258b-4ac5-ab96-ac1e5e61d3a7 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:47:33 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-b606de9f-258b-4ac5-ab96-ac1e5e61d3a7 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Deleted volume successfully. Jul 10 04:47:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b606de9f-258b-4ac5-ab96-ac1e5e61d3a7 tempest-CreateVolumesFromSourceVolumeTest-1621822840 None] Lock "cinder-0750db9f-b504-4c4e-9180-6e397df13ab6-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:34 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cedf5edc-5f0f-49f4-8419-832d2214a244 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774" returned: 0 in 0.935s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cedf5edc-5f0f-49f4-8419-832d2214a244 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:34 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774 Jul 10 04:47:34 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:35 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cedf5edc-5f0f-49f4-8419-832d2214a244 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-307de802-3cca-4a4c-8276-721a04bd2774" returned: 0 in 0.773s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cedf5edc-5f0f-49f4-8419-832d2214a244 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Lock "cinder-quobyte-307de802-3cca-4a4c-8276-721a04bd2774" released by "delete_volume" :: held 1.766s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:35 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-cedf5edc-5f0f-49f4-8419-832d2214a244 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Created reservations ['e5b00908-9698-46b5-be0b-a5f3c1f973e1', '77d500e5-6ffe-4184-ab61-63ad07b8026f', 'cdbceab4-838e-4562-ba06-be981164d938', '0cd724f1-26c7-4ee3-936d-c7bbcba88d48'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:47:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-cedf5edc-5f0f-49f4-8419-832d2214a244 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-cedf5edc-5f0f-49f4-8419-832d2214a244 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-cedf5edc-5f0f-49f4-8419-832d2214a244 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-cedf5edc-5f0f-49f4-8419-832d2214a244 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-cedf5edc-5f0f-49f4-8419-832d2214a244 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cedf5edc-5f0f-49f4-8419-832d2214a244 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:35 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:47:35 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:35 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cedf5edc-5f0f-49f4-8419-832d2214a244 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.649s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:35 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-cedf5edc-5f0f-49f4-8419-832d2214a244 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:47:35 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-cedf5edc-5f0f-49f4-8419-832d2214a244 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Deleted volume successfully. Jul 10 04:47:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cedf5edc-5f0f-49f4-8419-832d2214a244 tempest-VolumeSnapshotQuotasNegativeTestJSON-933980739 None] Lock "cinder-307de802-3cca-4a4c-8276-721a04bd2774-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:36 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-4d8fb1f3-1014-4ca6-a7f8-825e87bbdb16 req-925416f9-6a23-428a-b776-3b8b99c7e688 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Terminate volume connection completed successfully. Jul 10 04:47:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-4d8fb1f3-1014-4ca6-a7f8-825e87bbdb16 req-925416f9-6a23-428a-b776-3b8b99c7e688 tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Deleting attachment 532b5460-3fb5-4d7c-af72-526acb4bb26e. {{(pid=87359) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5106}} Jul 10 04:47:37 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:47:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Flow 'volume_create_manager' (3be62ddf-23c5-40cf-9fa3-acc74f750aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ba4655-989f-4f21-83d4-3519616dba3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ba4655-989f-4f21-83d4-3519616dba3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f17f4eeb-a57b-48ce-b669-a7781fc3de5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b69f4c08a04df1aaa5adad801e0920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:37Z,use_quota=True,user_id='cbc4469c54fd44bb80c5afe93633246a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6505b16-c1e1-46c5-98bc-4e60c97808a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6505b16-c1e1-46c5-98bc-4e60c97808a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82099a2a-4c5e-4426-a3cb-3eb9bb30b17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82099a2a-4c5e-4426-a3cb-3eb9bb30b17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f17f4eeb-a57b-48ce-b669-a7781fc3de5a', 'volume_name': 'volume-f17f4eeb-a57b-48ce-b669-a7781fc3de5a', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a776c3-3e0c-4728-ad21-bb66e8fe5841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a776c3-3e0c-4728-ad21-bb66e8fe5841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5443e9dd-1718-47e4-b9a7-44dcef676dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:37 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Volume f17f4eeb-a57b-48ce-b669-a7781fc3de5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f17f4eeb-a57b-48ce-b669-a7781fc3de5a', 'volume_size': 1} Jul 10 04:47:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f17f4eeb-a57b-48ce-b669-a7781fc3de5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b69f4c08a04df1aaa5adad801e0920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:37Z,use_quota=True,user_id='cbc4469c54fd44bb80c5afe93633246a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:47:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Creating volume f17f4eeb-a57b-48ce-b669-a7781fc3de5a {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:47:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:47:37 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:47:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f17f4eeb-a57b-48ce-b669-a7781fc3de5a 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:37 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f17f4eeb-a57b-48ce-b669-a7781fc3de5a 1073741824 Jul 10 04:47:37 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:38 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f17f4eeb-a57b-48ce-b669-a7781fc3de5a 1073741824" returned: 0 in 0.926s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f17f4eeb-a57b-48ce-b669-a7781fc3de5a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:38 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f17f4eeb-a57b-48ce-b669-a7781fc3de5a Jul 10 04:47:38 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-466aee19-27c2-4090-aacb-156a7c22f5ae tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Acquiring lock "cinder-e541f69d-5df3-4a7d-b22c-b24572ef4857-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-466aee19-27c2-4090-aacb-156a7c22f5ae tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Lock "cinder-e541f69d-5df3-4a7d-b22c-b24572ef4857-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-466aee19-27c2-4090-aacb-156a7c22f5ae tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Acquiring lock "cinder-quobyte-e541f69d-5df3-4a7d-b22c-b24572ef4857" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-466aee19-27c2-4090-aacb-156a7c22f5ae tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Lock "cinder-quobyte-e541f69d-5df3-4a7d-b22c-b24572ef4857" acquired by "delete_volume" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:38 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbba01e-7703-45e9-8b9a-4db97a8e0f80]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-466aee19-27c2-4090-aacb-156a7c22f5ae tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e541f69d-5df3-4a7d-b22c-b24572ef4857 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:38 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e541f69d-5df3-4a7d-b22c-b24572ef4857 Jul 10 04:47:38 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:39 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f17f4eeb-a57b-48ce-b669-a7781fc3de5a" returned: 0 in 0.718s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5443e9dd-1718-47e4-b9a7-44dcef676dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f17f4eeb-a57b-48ce-b669-a7781fc3de5a', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f15d6b-20c7-43d7-9d3e-0bcf986a7860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:39 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Volume volume-f17f4eeb-a57b-48ce-b669-a7781fc3de5a (f17f4eeb-a57b-48ce-b669-a7781fc3de5a): created successfully Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f15d6b-20c7-43d7-9d3e-0bcf986a7860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Flow 'volume_create_manager' (3be62ddf-23c5-40cf-9fa3-acc74f750aaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:39 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-3ee33e0f-d30b-4c1a-b8e6-6ff646d618b8 tempest-CinderUnicodeTest-1114044153 None] Created volume successfully. Jul 10 04:47:39 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-466aee19-27c2-4090-aacb-156a7c22f5ae tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e541f69d-5df3-4a7d-b22c-b24572ef4857" returned: 0 in 0.907s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-466aee19-27c2-4090-aacb-156a7c22f5ae tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e541f69d-5df3-4a7d-b22c-b24572ef4857 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:39 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e541f69d-5df3-4a7d-b22c-b24572ef4857 Jul 10 04:47:39 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Flow 'volume_create_manager' (e4c91df6-b0d4-400a-9c8c-8ccb1242e489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e05cbb3-5cd7-4eb5-8499-68a6d2a003a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e05cbb3-5cd7-4eb5-8499-68a6d2a003a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-982568561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6eb8e9a-5052-4725-9ca9-dd7b74e221f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b69f4c08a04df1aaa5adad801e0920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:40Z,use_quota=True,user_id='cbc4469c54fd44bb80c5afe93633246a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee760655-457e-481a-a73b-1fd7e3017e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee760655-457e-481a-a73b-1fd7e3017e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff6a780e-108d-4528-be46-27d7bd578b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff6a780e-108d-4528-be46-27d7bd578b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6eb8e9a-5052-4725-9ca9-dd7b74e221f6', 'volume_name': 'volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5841385b-3631-4ab3-ace0-2e404939c2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5841385b-3631-4ab3-ace0-2e404939c2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b290f3c-0e70-472a-a04c-f8817b7e3a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:39 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Volume a6eb8e9a-5052-4725-9ca9-dd7b74e221f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6', 'volume_size': 1} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-982568561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6eb8e9a-5052-4725-9ca9-dd7b74e221f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b69f4c08a04df1aaa5adad801e0920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:40Z,use_quota=True,user_id='cbc4469c54fd44bb80c5afe93633246a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Creating volume a6eb8e9a-5052-4725-9ca9-dd7b74e221f6 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:47:40 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:47:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:40 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6 1073741824 Jul 10 04:47:40 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:40 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-466aee19-27c2-4090-aacb-156a7c22f5ae tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e541f69d-5df3-4a7d-b22c-b24572ef4857" returned: 0 in 0.705s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:40 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-466aee19-27c2-4090-aacb-156a7c22f5ae tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Lock "cinder-quobyte-e541f69d-5df3-4a7d-b22c-b24572ef4857" released by "delete_volume" :: held 1.661s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:40 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-466aee19-27c2-4090-aacb-156a7c22f5ae tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Created reservations ['1b596f9b-c8e0-4d50-9bb7-f74ac7ff5c37', '7d757c20-5a59-4b77-b694-157c3fee8699', '11af1e7f-0e1b-479c-b1e3-55fb7feb49bf', 'a019eac8-ac01-4057-988c-87cf2c764999'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:47:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-466aee19-27c2-4090-aacb-156a7c22f5ae tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-466aee19-27c2-4090-aacb-156a7c22f5ae tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-466aee19-27c2-4090-aacb-156a7c22f5ae tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-466aee19-27c2-4090-aacb-156a7c22f5ae tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-466aee19-27c2-4090-aacb-156a7c22f5ae tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-466aee19-27c2-4090-aacb-156a7c22f5ae tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:40 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:47:40 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:40 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6 1073741824" returned: 0 in 0.924s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:41 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6 Jul 10 04:47:41 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:41 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-466aee19-27c2-4090-aacb-156a7c22f5ae tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.846s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-466aee19-27c2-4090-aacb-156a7c22f5ae tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:47:41 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-466aee19-27c2-4090-aacb-156a7c22f5ae tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Deleted volume successfully. Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-466aee19-27c2-4090-aacb-156a7c22f5ae tempest-TestServerVolumeAttachScenarioOldVersion-1352075729 None] Lock "cinder-e541f69d-5df3-4a7d-b22c-b24572ef4857-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Flow 'volume_create_manager' (e2d74242-4222-4a27-a5f0-a9dcf20b04a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f67752f-0f5b-4d86-825e-62276934e602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f67752f-0f5b-4d86-825e-62276934e602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1024703403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf4a9e0-f0ea-4747-8a37-90619e20a699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d72b5a89eaf426e95beb65216cf7a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:41Z,use_quota=True,user_id='8e8954d0115f4e27b9b4277c04d8c941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a741c605-e063-46a3-bbbf-e6ef254b4d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a741c605-e063-46a3-bbbf-e6ef254b4d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08df7441-068a-4de0-a22d-83f4217ee013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG cinder.image.glance [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Creating Keystone auth plugin from conf {{(pid=87359) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08df7441-068a-4de0-a22d-83f4217ee013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bcf4a9e0-f0ea-4747-8a37-90619e20a699', 'volume_name': 'volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699', 'volume_size': 1, 'image_id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fde3189e780b4bb09257315f8463a754', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'created_at': datetime.datetime(2026, 7, 10, 2, 27, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 27, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f148b33-7c87-45fa-9b71-3295f9e93abc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d29b82c-2e26-4e2b-890b-064e37b1c52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d29b82c-2e26-4e2b-890b-064e37b1c52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:41 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f633e20-83b6-40df-bbae-c1320275a26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:41 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Volume bcf4a9e0-f0ea-4747-8a37-90619e20a699: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699', 'volume_size': 1, 'image_id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fde3189e780b4bb09257315f8463a754', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'created_at': datetime.datetime(2026, 7, 10, 2, 27, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 27, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f148b33-7c87-45fa-9b71-3295f9e93abc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Trying to clone bcf4a9e0-f0ea-4747-8a37-90619e20a699 from image 7f148b33-7c87-45fa-9b71-3295f9e93abc at location (None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}]). {{(pid=87359) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6" returned: 0 in 0.820s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b290f3c-0e70-472a-a04c-f8817b7e3a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d2a835-d02c-4b5b-803d-a2db6b6d8d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:41 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Volume volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6 (a6eb8e9a-5052-4725-9ca9-dd7b74e221f6): created successfully Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d2a835-d02c-4b5b-803d-a2db6b6d8d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Flow 'volume_create_manager' (e4c91df6-b0d4-400a-9c8c-8ccb1242e489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:41 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d1498829-8f16-4d6c-b018-669d80bbc2e4 tempest-CinderUnicodeTest-1114044153 None] Created volume successfully. Jul 10 04:47:42 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_pnxvjh2kdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Jul 10 04:47:42 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Image download 20.69 MB at 20.69 MB/s Jul 10 04:47:42 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34a9f09-4522-4527-a0fa-aeec199d3be4]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_pnxvjh2kdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-89de4496-9bde-46d3-aac0-55eddae82e46 tempest-CinderUnicodeTest-1114044153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-89de4496-9bde-46d3-aac0-55eddae82e46 tempest-CinderUnicodeTest-1114044153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-89de4496-9bde-46d3-aac0-55eddae82e46 tempest-CinderUnicodeTest-1114044153 None] Creating offline snapshot 5d6e8e43-9410-4119-aaef-68b3b262015b of volume a6eb8e9a-5052-4725-9ca9-dd7b74e221f6 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:47:42 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_pnxvjh2kdevstack@QuobyteHD Jul 10 04:47:42 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:42 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[6861e0da-6c57-4d00-9986-82b8d0ce4740]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89de4496-9bde-46d3-aac0-55eddae82e46 tempest-CinderUnicodeTest-1114044153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:42 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6 Jul 10 04:47:42 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:43 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_pnxvjh2kdevstack@QuobyteHD" returned: 0 in 0.929s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:43 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Temporary image 7f148b33-7c87-45fa-9b71-3295f9e93abc is fetched for user 8e8954d0115f4e27b9b4277c04d8c941. {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Jul 10 04:47:43 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[edda2970-b30c-4893-9d30-ce8723239d8e]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_pnxvjh2kdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:43 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_pnxvjh2kdevstack@QuobyteHD Jul 10 04:47:43 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:43 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89de4496-9bde-46d3-aac0-55eddae82e46 tempest-CinderUnicodeTest-1114044153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6" returned: 0 in 1.042s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89de4496-9bde-46d3-aac0-55eddae82e46 tempest-CinderUnicodeTest-1114044153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.5d6e8e43-9410-4119-aaef-68b3b262015b 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:43 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.5d6e8e43-9410-4119-aaef-68b3b262015b 1G Jul 10 04:47:43 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:44 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_pnxvjh2kdevstack@QuobyteHD" returned: 0 in 0.804s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:44 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89de4496-9bde-46d3-aac0-55eddae82e46 tempest-CinderUnicodeTest-1114044153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.5d6e8e43-9410-4119-aaef-68b3b262015b 1G" returned: 0 in 1.008s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89de4496-9bde-46d3-aac0-55eddae82e46 tempest-CinderUnicodeTest-1114044153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.5d6e8e43-9410-4119-aaef-68b3b262015b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:44 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.5d6e8e43-9410-4119-aaef-68b3b262015b Jul 10 04:47:44 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:45 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89de4496-9bde-46d3-aac0-55eddae82e46 tempest-CinderUnicodeTest-1114044153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.5d6e8e43-9410-4119-aaef-68b3b262015b" returned: 0 in 0.728s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:45 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-89de4496-9bde-46d3-aac0-55eddae82e46 tempest-CinderUnicodeTest-1114044153 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.5d6e8e43-9410-4119-aaef-68b3b262015b is being set with open permissions: ugo+rw Jul 10 04:47:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89de4496-9bde-46d3-aac0-55eddae82e46 tempest-CinderUnicodeTest-1114044153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.5d6e8e43-9410-4119-aaef-68b3b262015b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:45 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.5d6e8e43-9410-4119-aaef-68b3b262015b Jul 10 04:47:45 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:45 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89de4496-9bde-46d3-aac0-55eddae82e46 tempest-CinderUnicodeTest-1114044153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.5d6e8e43-9410-4119-aaef-68b3b262015b" returned: 0 in 0.648s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89de4496-9bde-46d3-aac0-55eddae82e46 tempest-CinderUnicodeTest-1114044153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:45 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.info Jul 10 04:47:45 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:46 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89de4496-9bde-46d3-aac0-55eddae82e46 tempest-CinderUnicodeTest-1114044153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.info" returned: 0 in 0.717s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:46 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-89de4496-9bde-46d3-aac0-55eddae82e46 tempest-CinderUnicodeTest-1114044153 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.info is being set with open permissions: ugo+rw Jul 10 04:47:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89de4496-9bde-46d3-aac0-55eddae82e46 tempest-CinderUnicodeTest-1114044153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:46 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.info Jul 10 04:47:46 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:47 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89de4496-9bde-46d3-aac0-55eddae82e46 tempest-CinderUnicodeTest-1114044153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.info" returned: 0 in 0.662s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-89de4496-9bde-46d3-aac0-55eddae82e46 tempest-CinderUnicodeTest-1114044153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.929s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.170s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1024703403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf4a9e0-f0ea-4747-8a37-90619e20a699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d72b5a89eaf426e95beb65216cf7a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:41Z,use_quota=True,user_id='8e8954d0115f4e27b9b4277c04d8c941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Creating volume bcf4a9e0-f0ea-4747-8a37-90619e20a699 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:47:47 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=157,cinder:SELECT=123,cinder:DELETE=13,cinder:INSERT=26 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:47:47 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699 1073741824 Jul 10 04:47:47 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:47 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-89de4496-9bde-46d3-aac0-55eddae82e46 tempest-CinderUnicodeTest-1114044153 None] Create snapshot completed successfully Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-53dcfada-55c7-45e2-8424-74d3477fb2b0 tempest-CinderUnicodeTest-1114044153 None] Acquiring lock "cinder-5d6e8e43-9410-4119-aaef-68b3b262015b-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-53dcfada-55c7-45e2-8424-74d3477fb2b0 tempest-CinderUnicodeTest-1114044153 None] Lock "cinder-5d6e8e43-9410-4119-aaef-68b3b262015b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-53dcfada-55c7-45e2-8424-74d3477fb2b0 tempest-CinderUnicodeTest-1114044153 None] Acquiring lock "cinder-quobyte-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-53dcfada-55c7-45e2-8424-74d3477fb2b0 tempest-CinderUnicodeTest-1114044153 None] Lock "cinder-quobyte-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-53dcfada-55c7-45e2-8424-74d3477fb2b0 tempest-CinderUnicodeTest-1114044153 None] Acquiring lock "cinder-quobyte-5d6e8e43-9410-4119-aaef-68b3b262015b" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-53dcfada-55c7-45e2-8424-74d3477fb2b0 tempest-CinderUnicodeTest-1114044153 None] Lock "cinder-quobyte-5d6e8e43-9410-4119-aaef-68b3b262015b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-53dcfada-55c7-45e2-8424-74d3477fb2b0 tempest-CinderUnicodeTest-1114044153 None] Deleting offline snapshot 5d6e8e43-9410-4119-aaef-68b3b262015b of volume a6eb8e9a-5052-4725-9ca9-dd7b74e221f6 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-53dcfada-55c7-45e2-8424-74d3477fb2b0 tempest-CinderUnicodeTest-1114044153 None] snapshot_file for this snap is: volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.5d6e8e43-9410-4119-aaef-68b3b262015b {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b8868e-051c-4364-9101-8a265e3308aa]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-53dcfada-55c7-45e2-8424-74d3477fb2b0 tempest-CinderUnicodeTest-1114044153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.5d6e8e43-9410-4119-aaef-68b3b262015b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:47 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.5d6e8e43-9410-4119-aaef-68b3b262015b Jul 10 04:47:47 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:48 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699 1073741824" returned: 0 in 0.871s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:48 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699 Jul 10 04:47:48 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:48 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-53dcfada-55c7-45e2-8424-74d3477fb2b0 tempest-CinderUnicodeTest-1114044153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.5d6e8e43-9410-4119-aaef-68b3b262015b" returned: 0 in 0.785s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-53dcfada-55c7-45e2-8424-74d3477fb2b0 tempest-CinderUnicodeTest-1114044153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:47:48 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[77694ccb-976c-4fac-b33d-cb4d19744565]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-53dcfada-55c7-45e2-8424-74d3477fb2b0 tempest-CinderUnicodeTest-1114044153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:48 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6 Jul 10 04:47:48 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:48 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699" returned: 0 in 0.709s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:47:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:48 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Attempting download of 7f148b33-7c87-45fa-9b71-3295f9e93abc ((None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}])) to volume bcf4a9e0-f0ea-4747-8a37-90619e20a699. {{(pid=87359) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 04:47:48 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88507dd-71af-41ed-944b-f87c9fd120e6]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_dt3tof1w {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:49 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_dt3tof1w Jul 10 04:47:49 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:49 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-53dcfada-55c7-45e2-8424-74d3477fb2b0 tempest-CinderUnicodeTest-1114044153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6" returned: 0 in 0.850s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-53dcfada-55c7-45e2-8424-74d3477fb2b0 tempest-CinderUnicodeTest-1114044153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.5d6e8e43-9410-4119-aaef-68b3b262015b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:49 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.5d6e8e43-9410-4119-aaef-68b3b262015b Jul 10 04:47:49 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:49 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_dt3tof1w" returned: 0 in 0.758s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_dt3tof1w {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:49 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_dt3tof1w Jul 10 04:47:49 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:50 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-53dcfada-55c7-45e2-8424-74d3477fb2b0 tempest-CinderUnicodeTest-1114044153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.5d6e8e43-9410-4119-aaef-68b3b262015b" returned: 0 in 0.770s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-53dcfada-55c7-45e2-8424-74d3477fb2b0 tempest-CinderUnicodeTest-1114044153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.5d6e8e43-9410-4119-aaef-68b3b262015b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:50 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.5d6e8e43-9410-4119-aaef-68b3b262015b Jul 10 04:47:50 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:50 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_dt3tof1w" returned: 1 in 0.802s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_dt3tof1w' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:47:50 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acd3e83-93af-4444-8424-6a07c6cc24e0]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_pnxvjh2kdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:50 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_pnxvjh2kdevstack@QuobyteHD Jul 10 04:47:50 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:50 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-53dcfada-55c7-45e2-8424-74d3477fb2b0 tempest-CinderUnicodeTest-1114044153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6.5d6e8e43-9410-4119-aaef-68b3b262015b" returned: 0 in 0.681s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-53dcfada-55c7-45e2-8424-74d3477fb2b0 tempest-CinderUnicodeTest-1114044153 None] Lock "cinder-quobyte-5d6e8e43-9410-4119-aaef-68b3b262015b" released by "_delete_snapshot" :: held 3.228s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-53dcfada-55c7-45e2-8424-74d3477fb2b0 tempest-CinderUnicodeTest-1114044153 None] Lock "cinder-quobyte-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6" released by "delete_snapshot" :: held 3.253s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:50 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-53dcfada-55c7-45e2-8424-74d3477fb2b0 tempest-CinderUnicodeTest-1114044153 None] Created reservations ['81090cfd-0078-49b7-8b86-b8f2646f47b3', 'cc6c82a0-fde0-4fe1-83b7-14a17d24c3de', '2a77cc2e-b42f-4cbe-a5b4-de64c72d6dee', '4257aa51-41ba-49f2-84a7-d257680323d6'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:47:51 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-53dcfada-55c7-45e2-8424-74d3477fb2b0 tempest-CinderUnicodeTest-1114044153 None] Delete snapshot completed successfully. Jul 10 04:47:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-53dcfada-55c7-45e2-8424-74d3477fb2b0 tempest-CinderUnicodeTest-1114044153 None] Lock "cinder-5d6e8e43-9410-4119-aaef-68b3b262015b-delete_snapshot" released by "delete_snapshot" :: held 3.464s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:51 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_pnxvjh2kdevstack@QuobyteHD" returned: 0 in 0.797s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:51 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] 7f148b33-7c87-45fa-9b71-3295f9e93abc was qcow2, converting to raw {{(pid=87359) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Jul 10 04:47:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_pnxvjh2kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:51 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_pnxvjh2kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699 Jul 10 04:47:51 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-016928ae-4bfb-4d5a-85cc-e3d5c16d71b3 tempest-CinderUnicodeTest-1114044153 None] Acquiring lock "cinder-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-016928ae-4bfb-4d5a-85cc-e3d5c16d71b3 tempest-CinderUnicodeTest-1114044153 None] Lock "cinder-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-016928ae-4bfb-4d5a-85cc-e3d5c16d71b3 tempest-CinderUnicodeTest-1114044153 None] Acquiring lock "cinder-quobyte-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-016928ae-4bfb-4d5a-85cc-e3d5c16d71b3 tempest-CinderUnicodeTest-1114044153 None] Lock "cinder-quobyte-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6" acquired by "delete_volume" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:52 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[948d260b-69b3-45ec-92c7-921525095957]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-016928ae-4bfb-4d5a-85cc-e3d5c16d71b3 tempest-CinderUnicodeTest-1114044153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:52 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6 Jul 10 04:47:52 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:53 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-016928ae-4bfb-4d5a-85cc-e3d5c16d71b3 tempest-CinderUnicodeTest-1114044153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6" returned: 0 in 1.086s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-016928ae-4bfb-4d5a-85cc-e3d5c16d71b3 tempest-CinderUnicodeTest-1114044153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:53 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6 Jul 10 04:47:53 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:53 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_pnxvjh2kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699" returned: 0 in 2.337s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:53 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_pnxvjh2kdevstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699 {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:47:53 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Converted 112.00 MB image at 47.90 MB/s Jul 10 04:47:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:53 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699 1G Jul 10 04:47:53 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:53 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-016928ae-4bfb-4d5a-85cc-e3d5c16d71b3 tempest-CinderUnicodeTest-1114044153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6" returned: 0 in 0.808s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-016928ae-4bfb-4d5a-85cc-e3d5c16d71b3 tempest-CinderUnicodeTest-1114044153 None] Lock "cinder-quobyte-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6" released by "delete_volume" :: held 1.961s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:53 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=149,cinder:SELECT=113,cinder:INSERT=44,cinder:DELETE=12 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:47:53 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-016928ae-4bfb-4d5a-85cc-e3d5c16d71b3 tempest-CinderUnicodeTest-1114044153 None] Created reservations ['aa889236-9752-4d3b-b938-5ce808690487', 'c9f156e1-92f7-45c7-a372-589d8377972e', 'e3f55543-568f-4711-90db-e7a68af67330', '0136969d-5441-4c2c-9679-92648257ca60'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:47:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-016928ae-4bfb-4d5a-85cc-e3d5c16d71b3 tempest-CinderUnicodeTest-1114044153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-016928ae-4bfb-4d5a-85cc-e3d5c16d71b3 tempest-CinderUnicodeTest-1114044153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-016928ae-4bfb-4d5a-85cc-e3d5c16d71b3 tempest-CinderUnicodeTest-1114044153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-016928ae-4bfb-4d5a-85cc-e3d5c16d71b3 tempest-CinderUnicodeTest-1114044153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-016928ae-4bfb-4d5a-85cc-e3d5c16d71b3 tempest-CinderUnicodeTest-1114044153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-016928ae-4bfb-4d5a-85cc-e3d5c16d71b3 tempest-CinderUnicodeTest-1114044153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:54 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:47:54 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-09aabb01-0e1a-4b9f-836d-fbecee906c80 tempest-CinderUnicodeTest-1114044153 None] Acquiring lock "cinder-f17f4eeb-a57b-48ce-b669-a7781fc3de5a-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-09aabb01-0e1a-4b9f-836d-fbecee906c80 tempest-CinderUnicodeTest-1114044153 None] Lock "cinder-f17f4eeb-a57b-48ce-b669-a7781fc3de5a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-09aabb01-0e1a-4b9f-836d-fbecee906c80 tempest-CinderUnicodeTest-1114044153 None] Acquiring lock "cinder-quobyte-f17f4eeb-a57b-48ce-b669-a7781fc3de5a" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-09aabb01-0e1a-4b9f-836d-fbecee906c80 tempest-CinderUnicodeTest-1114044153 None] Lock "cinder-quobyte-f17f4eeb-a57b-48ce-b669-a7781fc3de5a" acquired by "delete_volume" :: waited 0.027s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:54 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[513222d7-6811-4d5d-b830-74e24159a640]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-09aabb01-0e1a-4b9f-836d-fbecee906c80 tempest-CinderUnicodeTest-1114044153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f17f4eeb-a57b-48ce-b669-a7781fc3de5a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:54 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f17f4eeb-a57b-48ce-b669-a7781fc3de5a Jul 10 04:47:54 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:54 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699 1G" returned: 0 in 0.874s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:54 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74d5444-89f6-4d04-9319-6e037874a295]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:54 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699 Jul 10 04:47:54 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:54 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-016928ae-4bfb-4d5a-85cc-e3d5c16d71b3 tempest-CinderUnicodeTest-1114044153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.846s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:54 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-016928ae-4bfb-4d5a-85cc-e3d5c16d71b3 tempest-CinderUnicodeTest-1114044153 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:47:54 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-016928ae-4bfb-4d5a-85cc-e3d5c16d71b3 tempest-CinderUnicodeTest-1114044153 None] Deleted volume successfully. Jul 10 04:47:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-016928ae-4bfb-4d5a-85cc-e3d5c16d71b3 tempest-CinderUnicodeTest-1114044153 None] Lock "cinder-a6eb8e9a-5052-4725-9ca9-dd7b74e221f6-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:55 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-09aabb01-0e1a-4b9f-836d-fbecee906c80 tempest-CinderUnicodeTest-1114044153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f17f4eeb-a57b-48ce-b669-a7781fc3de5a" returned: 0 in 0.818s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-09aabb01-0e1a-4b9f-836d-fbecee906c80 tempest-CinderUnicodeTest-1114044153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f17f4eeb-a57b-48ce-b669-a7781fc3de5a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:55 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f17f4eeb-a57b-48ce-b669-a7781fc3de5a Jul 10 04:47:55 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:55 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699" returned: 0 in 0.920s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:55 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699 Jul 10 04:47:55 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:55 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-09aabb01-0e1a-4b9f-836d-fbecee906c80 tempest-CinderUnicodeTest-1114044153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f17f4eeb-a57b-48ce-b669-a7781fc3de5a" returned: 0 in 0.650s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-09aabb01-0e1a-4b9f-836d-fbecee906c80 tempest-CinderUnicodeTest-1114044153 None] Lock "cinder-quobyte-f17f4eeb-a57b-48ce-b669-a7781fc3de5a" released by "delete_volume" :: held 1.519s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:55 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-09aabb01-0e1a-4b9f-836d-fbecee906c80 tempest-CinderUnicodeTest-1114044153 None] Created reservations ['114bf427-0d0b-4040-983a-fd0c85090241', 'fea0387d-e3be-4b39-b61f-a1cf75c6b4a2', 'c1879dfd-517a-4952-8755-52375128f4ea', 'bfacd4f1-23e3-40bb-b136-9097ce26fd9c'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:47:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-09aabb01-0e1a-4b9f-836d-fbecee906c80 tempest-CinderUnicodeTest-1114044153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-09aabb01-0e1a-4b9f-836d-fbecee906c80 tempest-CinderUnicodeTest-1114044153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-09aabb01-0e1a-4b9f-836d-fbecee906c80 tempest-CinderUnicodeTest-1114044153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-09aabb01-0e1a-4b9f-836d-fbecee906c80 tempest-CinderUnicodeTest-1114044153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-09aabb01-0e1a-4b9f-836d-fbecee906c80 tempest-CinderUnicodeTest-1114044153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-09aabb01-0e1a-4b9f-836d-fbecee906c80 tempest-CinderUnicodeTest-1114044153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:56 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:47:56 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:56 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699" returned: 1 in 0.845s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:47:56 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Downloaded image 7f148b33-7c87-45fa-9b71-3295f9e93abc ((None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}])) to volume bcf4a9e0-f0ea-4747-8a37-90619e20a699 successfully. {{(pid=87359) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 04:47:56 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Temporary image 7f148b33-7c87-45fa-9b71-3295f9e93abc for user 8e8954d0115f4e27b9b4277c04d8c941 is deleted. {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Jul 10 04:47:56 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Marking volume bcf4a9e0-f0ea-4747-8a37-90619e20a699 as bootable. {{(pid=87359) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 04:47:56 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Copying metadata from image 7f148b33-7c87-45fa-9b71-3295f9e93abc to bcf4a9e0-f0ea-4747-8a37-90619e20a699. {{(pid=87359) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 04:47:56 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Creating volume glance metadata for volume bcf4a9e0-f0ea-4747-8a37-90619e20a699 backed by image 7f148b33-7c87-45fa-9b71-3295f9e93abc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87359) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 04:47:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f633e20-83b6-40df-bbae-c1320275a26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699', 'volume_size': 1, 'image_id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fde3189e780b4bb09257315f8463a754', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'created_at': datetime.datetime(2026, 7, 10, 2, 27, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 27, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f148b33-7c87-45fa-9b71-3295f9e93abc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43598bb4-9c76-4ae9-84f9-95fcc5bd4f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:56 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Volume volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699 (bcf4a9e0-f0ea-4747-8a37-90619e20a699): created successfully Jul 10 04:47:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43598bb4-9c76-4ae9-84f9-95fcc5bd4f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:56 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Flow 'volume_create_manager' (e2d74242-4222-4a27-a5f0-a9dcf20b04a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:56 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-1078cd81-cfaf-4a93-9345-0471078b0359 tempest-VolumesImageMetadata-626265582 None] Created volume successfully. Jul 10 04:47:56 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-09aabb01-0e1a-4b9f-836d-fbecee906c80 tempest-CinderUnicodeTest-1114044153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.857s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:56 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-09aabb01-0e1a-4b9f-836d-fbecee906c80 tempest-CinderUnicodeTest-1114044153 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:47:56 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-09aabb01-0e1a-4b9f-836d-fbecee906c80 tempest-CinderUnicodeTest-1114044153 None] Deleted volume successfully. Jul 10 04:47:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-09aabb01-0e1a-4b9f-836d-fbecee906c80 tempest-CinderUnicodeTest-1114044153 None] Lock "cinder-f17f4eeb-a57b-48ce-b669-a7781fc3de5a-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:58 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] Acquiring lock "cinder-bcf4a9e0-f0ea-4747-8a37-90619e20a699-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:58 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] Lock "cinder-bcf4a9e0-f0ea-4747-8a37-90619e20a699-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:58 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] Acquiring lock "cinder-quobyte-bcf4a9e0-f0ea-4747-8a37-90619e20a699" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:58 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] Lock "cinder-quobyte-bcf4a9e0-f0ea-4747-8a37-90619e20a699" acquired by "delete_volume" :: waited 0.027s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:58 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd52e22e-fbc7-42df-a456-7b0ec4d9014f]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:58 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699 Jul 10 04:47:58 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:59 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699" returned: 0 in 0.882s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:59 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699 Jul 10 04:47:59 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:59 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699" returned: 1 in 0.807s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:47:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:00 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699 Jul 10 04:48:00 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:00 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bcf4a9e0-f0ea-4747-8a37-90619e20a699" returned: 0 in 0.695s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:00 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] Lock "cinder-quobyte-bcf4a9e0-f0ea-4747-8a37-90619e20a699" released by "delete_volume" :: held 2.462s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:00 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] Created reservations ['db40f1de-e0f7-4a55-ac32-db4c0a5f9259', '7b5f3e39-d1e0-4082-9f60-17f9132acc41', 'c725f3a7-464c-428b-a8a1-82adc908e240', '99ac9940-9a48-40d8-8a1f-06729d220b98'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:48:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:00 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:48:00 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:00 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:48:00 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Flow 'volume_create_manager' (98ee2c8e-84a3-41af-b6e5-ee0c4a62415a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:00 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ff8903-6440-4cf0-92aa-8826839e20f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ff8903-6440-4cf0-92aa-8826839e20f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2115225884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a19dda4-2671-4ab8-bbfc-ef606a436cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b3ffba828e4e2fbc4be631be649d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:01Z,use_quota=True,user_id='5eb18d71ad114375917cddf8d7716f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d7cd79d-cf01-43f6-85e0-e6ed3bf63725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d7cd79d-cf01-43f6-85e0-e6ed3bf63725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4144e8-f7ee-4c80-8d0d-121361aef8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4144e8-f7ee-4c80-8d0d-121361aef8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a19dda4-2671-4ab8-bbfc-ef606a436cfc', 'volume_name': 'volume-1a19dda4-2671-4ab8-bbfc-ef606a436cfc', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2b5658-8f3a-4318-a829-f3006370c6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2b5658-8f3a-4318-a829-f3006370c6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba5cc30-f664-48cc-bcea-273587029a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:01 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Volume 1a19dda4-2671-4ab8-bbfc-ef606a436cfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a19dda4-2671-4ab8-bbfc-ef606a436cfc', 'volume_size': 1} Jul 10 04:48:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2115225884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a19dda4-2671-4ab8-bbfc-ef606a436cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b3ffba828e4e2fbc4be631be649d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:01Z,use_quota=True,user_id='5eb18d71ad114375917cddf8d7716f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:48:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Creating volume 1a19dda4-2671-4ab8-bbfc-ef606a436cfc {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:48:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:48:01 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:48:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1a19dda4-2671-4ab8-bbfc-ef606a436cfc 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:01 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1a19dda4-2671-4ab8-bbfc-ef606a436cfc 1073741824 Jul 10 04:48:01 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:01 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.726s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:01 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:48:01 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] Deleted volume successfully. Jul 10 04:48:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a78604fb-af41-4a1f-adf5-83f014776326 tempest-VolumesImageMetadata-626265582 None] Lock "cinder-bcf4a9e0-f0ea-4747-8a37-90619e20a699-delete_volume" released by "delete_volume" :: held 3.460s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:02 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1a19dda4-2671-4ab8-bbfc-ef606a436cfc 1073741824" returned: 0 in 0.989s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1a19dda4-2671-4ab8-bbfc-ef606a436cfc {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:02 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1a19dda4-2671-4ab8-bbfc-ef606a436cfc Jul 10 04:48:02 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:02 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1a19dda4-2671-4ab8-bbfc-ef606a436cfc" returned: 0 in 0.753s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:48:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba5cc30-f664-48cc-bcea-273587029a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a19dda4-2671-4ab8-bbfc-ef606a436cfc', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b27e8d-0810-496f-a40c-8b2470cc1036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:02 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Volume volume-1a19dda4-2671-4ab8-bbfc-ef606a436cfc (1a19dda4-2671-4ab8-bbfc-ef606a436cfc): created successfully Jul 10 04:48:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b27e8d-0810-496f-a40c-8b2470cc1036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Flow 'volume_create_manager' (98ee2c8e-84a3-41af-b6e5-ee0c4a62415a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:02 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-445fc115-1871-4e31-9fc5-9b12eb24e17a tempest-ProjectReaderTests-2060290037 None] Created volume successfully. Jul 10 04:48:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8e2f7657-4385-4a65-bef5-a7e9b20a43dd tempest-ProjectReaderTests-2060290037 None] Acquiring lock "cinder-1a19dda4-2671-4ab8-bbfc-ef606a436cfc-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8e2f7657-4385-4a65-bef5-a7e9b20a43dd tempest-ProjectReaderTests-2060290037 None] Lock "cinder-1a19dda4-2671-4ab8-bbfc-ef606a436cfc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8e2f7657-4385-4a65-bef5-a7e9b20a43dd tempest-ProjectReaderTests-2060290037 None] Acquiring lock "cinder-quobyte-1a19dda4-2671-4ab8-bbfc-ef606a436cfc" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8e2f7657-4385-4a65-bef5-a7e9b20a43dd tempest-ProjectReaderTests-2060290037 None] Lock "cinder-quobyte-1a19dda4-2671-4ab8-bbfc-ef606a436cfc" acquired by "delete_volume" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:03 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0905089-120f-4a19-9492-b605aa8be8df]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8e2f7657-4385-4a65-bef5-a7e9b20a43dd tempest-ProjectReaderTests-2060290037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1a19dda4-2671-4ab8-bbfc-ef606a436cfc {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:03 devstack sudo[101079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1a19dda4-2671-4ab8-bbfc-ef606a436cfc Jul 10 04:48:03 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:04 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8e2f7657-4385-4a65-bef5-a7e9b20a43dd tempest-ProjectReaderTests-2060290037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1a19dda4-2671-4ab8-bbfc-ef606a436cfc" returned: 0 in 0.867s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8e2f7657-4385-4a65-bef5-a7e9b20a43dd tempest-ProjectReaderTests-2060290037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1a19dda4-2671-4ab8-bbfc-ef606a436cfc {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:04 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1a19dda4-2671-4ab8-bbfc-ef606a436cfc Jul 10 04:48:04 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:05 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8e2f7657-4385-4a65-bef5-a7e9b20a43dd tempest-ProjectReaderTests-2060290037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1a19dda4-2671-4ab8-bbfc-ef606a436cfc" returned: 0 in 0.899s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8e2f7657-4385-4a65-bef5-a7e9b20a43dd tempest-ProjectReaderTests-2060290037 None] Lock "cinder-quobyte-1a19dda4-2671-4ab8-bbfc-ef606a436cfc" released by "delete_volume" :: held 1.818s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:05 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-8e2f7657-4385-4a65-bef5-a7e9b20a43dd tempest-ProjectReaderTests-2060290037 None] Created reservations ['6a9c34c0-39cd-4ed9-9fd6-7c016c3f8e1c', 'e8953c90-6b12-405a-9ea5-9e68df63def4', 'e8cbef95-9a0d-48ac-b8d6-2f665288f624', '20fb0e8c-aa7e-4691-9ad5-ebb7f6968420'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:48:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8e2f7657-4385-4a65-bef5-a7e9b20a43dd tempest-ProjectReaderTests-2060290037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8e2f7657-4385-4a65-bef5-a7e9b20a43dd tempest-ProjectReaderTests-2060290037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8e2f7657-4385-4a65-bef5-a7e9b20a43dd tempest-ProjectReaderTests-2060290037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8e2f7657-4385-4a65-bef5-a7e9b20a43dd tempest-ProjectReaderTests-2060290037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8e2f7657-4385-4a65-bef5-a7e9b20a43dd tempest-ProjectReaderTests-2060290037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8e2f7657-4385-4a65-bef5-a7e9b20a43dd tempest-ProjectReaderTests-2060290037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:05 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:48:05 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:06 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8e2f7657-4385-4a65-bef5-a7e9b20a43dd tempest-ProjectReaderTests-2060290037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.681s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-8e2f7657-4385-4a65-bef5-a7e9b20a43dd tempest-ProjectReaderTests-2060290037 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:48:06 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-8e2f7657-4385-4a65-bef5-a7e9b20a43dd tempest-ProjectReaderTests-2060290037 None] Deleted volume successfully. Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8e2f7657-4385-4a65-bef5-a7e9b20a43dd tempest-ProjectReaderTests-2060290037 None] Lock "cinder-1a19dda4-2671-4ab8-bbfc-ef606a436cfc-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Flow 'volume_create_manager' (d72ab77f-0c95-4175-b374-41161f0b9d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeab0c31-502a-402d-9cdd-48da03d74c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeab0c31-502a-402d-9cdd-48da03d74c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1907943802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9542103-42cd-43e8-b331-4f0a7c2fb493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b3ffba828e4e2fbc4be631be649d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:06Z,use_quota=True,user_id='5eb18d71ad114375917cddf8d7716f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1be6eb-f180-4ec0-9db3-a08fcb5de43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1be6eb-f180-4ec0-9db3-a08fcb5de43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10372674-400e-4a02-a9d4-cfd5f744d0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10372674-400e-4a02-a9d4-cfd5f744d0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9542103-42cd-43e8-b331-4f0a7c2fb493', 'volume_name': 'volume-f9542103-42cd-43e8-b331-4f0a7c2fb493', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f772c027-271f-4361-a189-ec99c59b471b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f772c027-271f-4361-a189-ec99c59b471b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df968464-cd47-4d2e-8b75-8bbda240b5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:06 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Volume f9542103-42cd-43e8-b331-4f0a7c2fb493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9542103-42cd-43e8-b331-4f0a7c2fb493', 'volume_size': 1} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1907943802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9542103-42cd-43e8-b331-4f0a7c2fb493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b3ffba828e4e2fbc4be631be649d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:06Z,use_quota=True,user_id='5eb18d71ad114375917cddf8d7716f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Creating volume f9542103-42cd-43e8-b331-4f0a7c2fb493 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:48:06 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f9542103-42cd-43e8-b331-4f0a7c2fb493 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:06 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f9542103-42cd-43e8-b331-4f0a7c2fb493 1073741824 Jul 10 04:48:06 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Flow 'volume_create_manager' (02d6afb6-2e72-47a4-9cf0-37ea6cadfb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40bc251-f34a-4664-9f5e-4f123fcf7a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40bc251-f34a-4664-9f5e-4f123fcf7a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2047695211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b019a0db-23fb-4b9b-a2ec-25457bfb75ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c148dae5c616491f926c04929eebc885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:06Z,use_quota=True,user_id='85de81c2a89f4bb7b461cf2eb8cbf9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0fc85b-b646-49ea-a70d-5a2685a4a462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0fc85b-b646-49ea-a70d-5a2685a4a462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe06ce3-1ead-4c2f-a4d6-364083b7b9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe06ce3-1ead-4c2f-a4d6-364083b7b9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b019a0db-23fb-4b9b-a2ec-25457bfb75ea', 'volume_name': 'volume-b019a0db-23fb-4b9b-a2ec-25457bfb75ea', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e56a4b5-eb70-4780-bf6e-2be0efe026e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e56a4b5-eb70-4780-bf6e-2be0efe026e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70953f19-16ed-409d-91ce-65a5b14fb259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:06 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Volume b019a0db-23fb-4b9b-a2ec-25457bfb75ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b019a0db-23fb-4b9b-a2ec-25457bfb75ea', 'volume_size': 1} Jul 10 04:48:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:07 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f9542103-42cd-43e8-b331-4f0a7c2fb493 1073741824" returned: 0 in 0.853s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f9542103-42cd-43e8-b331-4f0a7c2fb493 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:07 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f9542103-42cd-43e8-b331-4f0a7c2fb493 Jul 10 04:48:07 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:08 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f9542103-42cd-43e8-b331-4f0a7c2fb493" returned: 0 in 0.678s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:48:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.404s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2047695211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b019a0db-23fb-4b9b-a2ec-25457bfb75ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c148dae5c616491f926c04929eebc885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:06Z,use_quota=True,user_id='85de81c2a89f4bb7b461cf2eb8cbf9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:48:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Creating volume b019a0db-23fb-4b9b-a2ec-25457bfb75ea {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:48:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:48:08 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:48:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b019a0db-23fb-4b9b-a2ec-25457bfb75ea 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:08 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b019a0db-23fb-4b9b-a2ec-25457bfb75ea 1073741824 Jul 10 04:48:08 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df968464-cd47-4d2e-8b75-8bbda240b5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9542103-42cd-43e8-b331-4f0a7c2fb493', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbb8d1ac-4076-43cd-b98f-73f326f123ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:08 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Volume volume-f9542103-42cd-43e8-b331-4f0a7c2fb493 (f9542103-42cd-43e8-b331-4f0a7c2fb493): created successfully Jul 10 04:48:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbb8d1ac-4076-43cd-b98f-73f326f123ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Flow 'volume_create_manager' (d72ab77f-0c95-4175-b374-41161f0b9d57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:08 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-08a833ed-f97d-4d10-adf0-7fa067486e07 tempest-ProjectReaderTests-2060290037 None] Created volume successfully. Jul 10 04:48:08 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b019a0db-23fb-4b9b-a2ec-25457bfb75ea 1073741824" returned: 0 in 0.840s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b019a0db-23fb-4b9b-a2ec-25457bfb75ea {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:09 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b019a0db-23fb-4b9b-a2ec-25457bfb75ea Jul 10 04:48:09 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:09 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-221ab55d-c4e2-431b-836a-a7e94b3d7765 tempest-ProjectReaderTests-2060290037 None] Acquiring lock "cinder-f9542103-42cd-43e8-b331-4f0a7c2fb493-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:09 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-221ab55d-c4e2-431b-836a-a7e94b3d7765 tempest-ProjectReaderTests-2060290037 None] Lock "cinder-f9542103-42cd-43e8-b331-4f0a7c2fb493-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:09 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-221ab55d-c4e2-431b-836a-a7e94b3d7765 tempest-ProjectReaderTests-2060290037 None] Acquiring lock "cinder-quobyte-f9542103-42cd-43e8-b331-4f0a7c2fb493" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:09 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-221ab55d-c4e2-431b-836a-a7e94b3d7765 tempest-ProjectReaderTests-2060290037 None] Lock "cinder-quobyte-f9542103-42cd-43e8-b331-4f0a7c2fb493" acquired by "delete_volume" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:09 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29ea169-f3c8-4f57-aa03-9e045cfe510f]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-221ab55d-c4e2-431b-836a-a7e94b3d7765 tempest-ProjectReaderTests-2060290037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f9542103-42cd-43e8-b331-4f0a7c2fb493 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:09 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f9542103-42cd-43e8-b331-4f0a7c2fb493 Jul 10 04:48:09 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:09 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b019a0db-23fb-4b9b-a2ec-25457bfb75ea" returned: 0 in 0.711s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:48:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70953f19-16ed-409d-91ce-65a5b14fb259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b019a0db-23fb-4b9b-a2ec-25457bfb75ea', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec43657f-c500-4226-a15e-ce2441f57509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:09 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Volume volume-b019a0db-23fb-4b9b-a2ec-25457bfb75ea (b019a0db-23fb-4b9b-a2ec-25457bfb75ea): created successfully Jul 10 04:48:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec43657f-c500-4226-a15e-ce2441f57509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Flow 'volume_create_manager' (02d6afb6-2e72-47a4-9cf0-37ea6cadfb13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:09 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ffec642b-8ea6-4134-9a6e-5e3670f04f86 tempest-AbsoluteLimitsTests-549006622 None] Created volume successfully. Jul 10 04:48:10 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-221ab55d-c4e2-431b-836a-a7e94b3d7765 tempest-ProjectReaderTests-2060290037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f9542103-42cd-43e8-b331-4f0a7c2fb493" returned: 0 in 0.778s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-221ab55d-c4e2-431b-836a-a7e94b3d7765 tempest-ProjectReaderTests-2060290037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f9542103-42cd-43e8-b331-4f0a7c2fb493 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:10 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f9542103-42cd-43e8-b331-4f0a7c2fb493 Jul 10 04:48:10 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-58c59777-3216-4968-a7f5-e28848c705b8 tempest-AbsoluteLimitsTests-549006622 None] Acquiring lock "cinder-b019a0db-23fb-4b9b-a2ec-25457bfb75ea-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-58c59777-3216-4968-a7f5-e28848c705b8 tempest-AbsoluteLimitsTests-549006622 None] Lock "cinder-b019a0db-23fb-4b9b-a2ec-25457bfb75ea-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-58c59777-3216-4968-a7f5-e28848c705b8 tempest-AbsoluteLimitsTests-549006622 None] Acquiring lock "cinder-quobyte-b019a0db-23fb-4b9b-a2ec-25457bfb75ea" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-58c59777-3216-4968-a7f5-e28848c705b8 tempest-AbsoluteLimitsTests-549006622 None] Lock "cinder-quobyte-b019a0db-23fb-4b9b-a2ec-25457bfb75ea" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:10 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea16d5f-a5eb-484b-a10a-d82873a26ecc]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-58c59777-3216-4968-a7f5-e28848c705b8 tempest-AbsoluteLimitsTests-549006622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b019a0db-23fb-4b9b-a2ec-25457bfb75ea {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:10 devstack sudo[101155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b019a0db-23fb-4b9b-a2ec-25457bfb75ea Jul 10 04:48:10 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:10 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-221ab55d-c4e2-431b-836a-a7e94b3d7765 tempest-ProjectReaderTests-2060290037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f9542103-42cd-43e8-b331-4f0a7c2fb493" returned: 0 in 0.682s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-221ab55d-c4e2-431b-836a-a7e94b3d7765 tempest-ProjectReaderTests-2060290037 None] Lock "cinder-quobyte-f9542103-42cd-43e8-b331-4f0a7c2fb493" released by "delete_volume" :: held 1.507s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:11 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-221ab55d-c4e2-431b-836a-a7e94b3d7765 tempest-ProjectReaderTests-2060290037 None] Created reservations ['36c68b15-955d-4f11-b1d1-c00e2f6d72b3', '3a688ad7-58b8-4bf7-a8b4-6b660624dec7', 'fc969fae-79de-455b-a698-aaeef7f9850d', 'dc294774-c8fc-46ab-84da-ac1330e8a668'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:48:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-221ab55d-c4e2-431b-836a-a7e94b3d7765 tempest-ProjectReaderTests-2060290037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-221ab55d-c4e2-431b-836a-a7e94b3d7765 tempest-ProjectReaderTests-2060290037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:11 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-221ab55d-c4e2-431b-836a-a7e94b3d7765 tempest-ProjectReaderTests-2060290037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:11 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-221ab55d-c4e2-431b-836a-a7e94b3d7765 tempest-ProjectReaderTests-2060290037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-221ab55d-c4e2-431b-836a-a7e94b3d7765 tempest-ProjectReaderTests-2060290037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-221ab55d-c4e2-431b-836a-a7e94b3d7765 tempest-ProjectReaderTests-2060290037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:11 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:48:11 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:11 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-58c59777-3216-4968-a7f5-e28848c705b8 tempest-AbsoluteLimitsTests-549006622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b019a0db-23fb-4b9b-a2ec-25457bfb75ea" returned: 0 in 0.795s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-58c59777-3216-4968-a7f5-e28848c705b8 tempest-AbsoluteLimitsTests-549006622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b019a0db-23fb-4b9b-a2ec-25457bfb75ea {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:11 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b019a0db-23fb-4b9b-a2ec-25457bfb75ea Jul 10 04:48:11 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:11 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-221ab55d-c4e2-431b-836a-a7e94b3d7765 tempest-ProjectReaderTests-2060290037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.696s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:11 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-221ab55d-c4e2-431b-836a-a7e94b3d7765 tempest-ProjectReaderTests-2060290037 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:48:11 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-221ab55d-c4e2-431b-836a-a7e94b3d7765 tempest-ProjectReaderTests-2060290037 None] Deleted volume successfully. Jul 10 04:48:11 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-221ab55d-c4e2-431b-836a-a7e94b3d7765 tempest-ProjectReaderTests-2060290037 None] Lock "cinder-f9542103-42cd-43e8-b331-4f0a7c2fb493-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:12 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-58c59777-3216-4968-a7f5-e28848c705b8 tempest-AbsoluteLimitsTests-549006622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b019a0db-23fb-4b9b-a2ec-25457bfb75ea" returned: 0 in 0.710s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:12 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-58c59777-3216-4968-a7f5-e28848c705b8 tempest-AbsoluteLimitsTests-549006622 None] Lock "cinder-quobyte-b019a0db-23fb-4b9b-a2ec-25457bfb75ea" released by "delete_volume" :: held 1.545s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:12 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-58c59777-3216-4968-a7f5-e28848c705b8 tempest-AbsoluteLimitsTests-549006622 None] Created reservations ['038f46dc-c379-41a9-80a9-8888571c4777', '36951e31-d039-4e80-ab9f-684c877e2e41', '20ed9699-e38a-4775-9bf1-f8c9727505cc', 'ee901ecf-6533-4125-9f3f-2cea167389d0'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:48:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-58c59777-3216-4968-a7f5-e28848c705b8 tempest-AbsoluteLimitsTests-549006622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-58c59777-3216-4968-a7f5-e28848c705b8 tempest-AbsoluteLimitsTests-549006622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-58c59777-3216-4968-a7f5-e28848c705b8 tempest-AbsoluteLimitsTests-549006622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-58c59777-3216-4968-a7f5-e28848c705b8 tempest-AbsoluteLimitsTests-549006622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-58c59777-3216-4968-a7f5-e28848c705b8 tempest-AbsoluteLimitsTests-549006622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-58c59777-3216-4968-a7f5-e28848c705b8 tempest-AbsoluteLimitsTests-549006622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:12 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:48:12 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:12 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-58c59777-3216-4968-a7f5-e28848c705b8 tempest-AbsoluteLimitsTests-549006622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.697s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:13 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-58c59777-3216-4968-a7f5-e28848c705b8 tempest-AbsoluteLimitsTests-549006622 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:48:13 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-58c59777-3216-4968-a7f5-e28848c705b8 tempest-AbsoluteLimitsTests-549006622 None] Deleted volume successfully. Jul 10 04:48:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-58c59777-3216-4968-a7f5-e28848c705b8 tempest-AbsoluteLimitsTests-549006622 None] Lock "cinder-b019a0db-23fb-4b9b-a2ec-25457bfb75ea-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:48:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:15 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:48:15 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:16 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.729s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:48:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:48:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:48:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:48:18 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:48:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Flow 'volume_create_manager' (4266ba68-20a9-46b1-9004-6cb0e4628824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5490de2a-aa7c-447b-8b3a-a12cf2371874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5490de2a-aa7c-447b-8b3a-a12cf2371874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-193123823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ec11fd-9125-47c5-82de-4b52a3144c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef0e8d972b0420a8ff06cea43a81bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:19Z,use_quota=True,user_id='465b3f0a9edf43f08e9a18bb7278b852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f04b9b9-8895-473b-9b52-a9a9cc3fbaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f04b9b9-8895-473b-9b52-a9a9cc3fbaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9d28b8-d607-4c36-88f3-bd1f4104961e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9d28b8-d607-4c36-88f3-bd1f4104961e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77ec11fd-9125-47c5-82de-4b52a3144c98', 'volume_name': 'volume-77ec11fd-9125-47c5-82de-4b52a3144c98', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5038f2-2974-46d1-9594-7bd6b29b8d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5038f2-2974-46d1-9594-7bd6b29b8d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8dcceb3-a02a-4c4b-953c-0ede277852d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:19 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Volume 77ec11fd-9125-47c5-82de-4b52a3144c98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77ec11fd-9125-47c5-82de-4b52a3144c98', 'volume_size': 1} Jul 10 04:48:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-193123823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ec11fd-9125-47c5-82de-4b52a3144c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef0e8d972b0420a8ff06cea43a81bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:19Z,use_quota=True,user_id='465b3f0a9edf43f08e9a18bb7278b852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:48:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Creating volume 77ec11fd-9125-47c5-82de-4b52a3144c98 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:48:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:48:19 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:48:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-77ec11fd-9125-47c5-82de-4b52a3144c98 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:19 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-77ec11fd-9125-47c5-82de-4b52a3144c98 1073741824 Jul 10 04:48:19 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:19 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-77ec11fd-9125-47c5-82de-4b52a3144c98 1073741824" returned: 0 in 0.831s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-77ec11fd-9125-47c5-82de-4b52a3144c98 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:19 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-77ec11fd-9125-47c5-82de-4b52a3144c98 Jul 10 04:48:19 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:20 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-77ec11fd-9125-47c5-82de-4b52a3144c98" returned: 0 in 0.644s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:48:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8dcceb3-a02a-4c4b-953c-0ede277852d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77ec11fd-9125-47c5-82de-4b52a3144c98', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44722bc8-ae8f-42b0-b0ef-1f26fe5313b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:20 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Volume volume-77ec11fd-9125-47c5-82de-4b52a3144c98 (77ec11fd-9125-47c5-82de-4b52a3144c98): created successfully Jul 10 04:48:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44722bc8-ae8f-42b0-b0ef-1f26fe5313b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Flow 'volume_create_manager' (4266ba68-20a9-46b1-9004-6cb0e4628824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:20 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d9a28ae1-ead8-46bd-9cee-1138b6f43d14 tempest-VolumesTransfersV355Test-2045794060 None] Created volume successfully. Jul 10 04:48:21 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-500351b5-5ba9-4244-8319-2b56ee55b090 tempest-VolumesTransfersV355Test-2114024895 None] Transfer volume completed successfully. Jul 10 04:48:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-87cbaabd-288a-431a-bc77-a32525efcab0 tempest-VolumesTransfersV355Test-870767852 None] Acquiring lock "cinder-77ec11fd-9125-47c5-82de-4b52a3144c98-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-87cbaabd-288a-431a-bc77-a32525efcab0 tempest-VolumesTransfersV355Test-870767852 None] Lock "cinder-77ec11fd-9125-47c5-82de-4b52a3144c98-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-87cbaabd-288a-431a-bc77-a32525efcab0 tempest-VolumesTransfersV355Test-870767852 None] Acquiring lock "cinder-quobyte-77ec11fd-9125-47c5-82de-4b52a3144c98" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-87cbaabd-288a-431a-bc77-a32525efcab0 tempest-VolumesTransfersV355Test-870767852 None] Lock "cinder-quobyte-77ec11fd-9125-47c5-82de-4b52a3144c98" acquired by "delete_volume" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:22 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fb2a98-f7ce-44bd-bd42-9ad853445886]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-87cbaabd-288a-431a-bc77-a32525efcab0 tempest-VolumesTransfersV355Test-870767852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-77ec11fd-9125-47c5-82de-4b52a3144c98 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:22 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-77ec11fd-9125-47c5-82de-4b52a3144c98 Jul 10 04:48:22 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:23 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-87cbaabd-288a-431a-bc77-a32525efcab0 tempest-VolumesTransfersV355Test-870767852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-77ec11fd-9125-47c5-82de-4b52a3144c98" returned: 0 in 0.759s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-87cbaabd-288a-431a-bc77-a32525efcab0 tempest-VolumesTransfersV355Test-870767852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-77ec11fd-9125-47c5-82de-4b52a3144c98 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:23 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-77ec11fd-9125-47c5-82de-4b52a3144c98 Jul 10 04:48:23 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:24 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-87cbaabd-288a-431a-bc77-a32525efcab0 tempest-VolumesTransfersV355Test-870767852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-77ec11fd-9125-47c5-82de-4b52a3144c98" returned: 0 in 0.666s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-87cbaabd-288a-431a-bc77-a32525efcab0 tempest-VolumesTransfersV355Test-870767852 None] Lock "cinder-quobyte-77ec11fd-9125-47c5-82de-4b52a3144c98" released by "delete_volume" :: held 1.464s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:24 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-87cbaabd-288a-431a-bc77-a32525efcab0 tempest-VolumesTransfersV355Test-870767852 None] Created reservations ['ac13ee2a-8f5d-4a0c-9fb1-c6fc40e90c94', '156dcb65-aadf-4c8c-a5c7-2aa5c4c61272', '772d3b18-a165-4d05-bc89-83d9e6808dd4', '6420fefb-4f71-4d6b-8705-98719ecb62fc'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:48:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-87cbaabd-288a-431a-bc77-a32525efcab0 tempest-VolumesTransfersV355Test-870767852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-87cbaabd-288a-431a-bc77-a32525efcab0 tempest-VolumesTransfersV355Test-870767852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-87cbaabd-288a-431a-bc77-a32525efcab0 tempest-VolumesTransfersV355Test-870767852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-87cbaabd-288a-431a-bc77-a32525efcab0 tempest-VolumesTransfersV355Test-870767852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-87cbaabd-288a-431a-bc77-a32525efcab0 tempest-VolumesTransfersV355Test-870767852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-87cbaabd-288a-431a-bc77-a32525efcab0 tempest-VolumesTransfersV355Test-870767852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:24 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:48:24 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:24 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-87cbaabd-288a-431a-bc77-a32525efcab0 tempest-VolumesTransfersV355Test-870767852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.629s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:24 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-87cbaabd-288a-431a-bc77-a32525efcab0 tempest-VolumesTransfersV355Test-870767852 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:48:24 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-87cbaabd-288a-431a-bc77-a32525efcab0 tempest-VolumesTransfersV355Test-870767852 None] Deleted volume successfully. Jul 10 04:48:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-87cbaabd-288a-431a-bc77-a32525efcab0 tempest-VolumesTransfersV355Test-870767852 None] Lock "cinder-77ec11fd-9125-47c5-82de-4b52a3144c98-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:25 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:48:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Flow 'volume_create_manager' (9acb17fe-ab87-4ada-a0bd-3dcf1441bdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b17fe97-7dde-40c1-8a2d-f0adbd2ca6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b17fe97-7dde-40c1-8a2d-f0adbd2ca6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-533909124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dddfc546-edc2-493e-9a11-5077a64f6fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef0e8d972b0420a8ff06cea43a81bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:25Z,use_quota=True,user_id='465b3f0a9edf43f08e9a18bb7278b852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd857319-f02d-4ae9-8953-51c43c5f6bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd857319-f02d-4ae9-8953-51c43c5f6bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d10a711-2491-4165-9629-7f9439ca0b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d10a711-2491-4165-9629-7f9439ca0b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dddfc546-edc2-493e-9a11-5077a64f6fb7', 'volume_name': 'volume-dddfc546-edc2-493e-9a11-5077a64f6fb7', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60152b34-69b5-437a-a0bd-d738a86c085b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60152b34-69b5-437a-a0bd-d738a86c085b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b1c453-f6d3-4788-8296-032929d47985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:25 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Volume dddfc546-edc2-493e-9a11-5077a64f6fb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dddfc546-edc2-493e-9a11-5077a64f6fb7', 'volume_size': 1} Jul 10 04:48:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-533909124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dddfc546-edc2-493e-9a11-5077a64f6fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef0e8d972b0420a8ff06cea43a81bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:25Z,use_quota=True,user_id='465b3f0a9edf43f08e9a18bb7278b852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:48:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Creating volume dddfc546-edc2-493e-9a11-5077a64f6fb7 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:48:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:48:25 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:48:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dddfc546-edc2-493e-9a11-5077a64f6fb7 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:25 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dddfc546-edc2-493e-9a11-5077a64f6fb7 1073741824 Jul 10 04:48:25 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:26 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dddfc546-edc2-493e-9a11-5077a64f6fb7 1073741824" returned: 0 in 0.805s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dddfc546-edc2-493e-9a11-5077a64f6fb7 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:26 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dddfc546-edc2-493e-9a11-5077a64f6fb7 Jul 10 04:48:26 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:26 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dddfc546-edc2-493e-9a11-5077a64f6fb7" returned: 0 in 0.617s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:48:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b1c453-f6d3-4788-8296-032929d47985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dddfc546-edc2-493e-9a11-5077a64f6fb7', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ef9f0f-e93f-44a1-bf7a-7bd1659f9bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:26 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Volume volume-dddfc546-edc2-493e-9a11-5077a64f6fb7 (dddfc546-edc2-493e-9a11-5077a64f6fb7): created successfully Jul 10 04:48:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ef9f0f-e93f-44a1-bf7a-7bd1659f9bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Flow 'volume_create_manager' (9acb17fe-ab87-4ada-a0bd-3dcf1441bdb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:26 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-5c60c82e-b913-4b3e-bd0e-08b8450cae3f tempest-VolumesTransfersV355Test-2045794060 None] Created volume successfully. Jul 10 04:48:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-97f9d312-32f4-446b-a895-fbcb9de12772 tempest-VolumesTransfersV355Test-870767852 None] Acquiring lock "cinder-dddfc546-edc2-493e-9a11-5077a64f6fb7-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-97f9d312-32f4-446b-a895-fbcb9de12772 tempest-VolumesTransfersV355Test-870767852 None] Lock "cinder-dddfc546-edc2-493e-9a11-5077a64f6fb7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-97f9d312-32f4-446b-a895-fbcb9de12772 tempest-VolumesTransfersV355Test-870767852 None] Acquiring lock "cinder-quobyte-dddfc546-edc2-493e-9a11-5077a64f6fb7" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-97f9d312-32f4-446b-a895-fbcb9de12772 tempest-VolumesTransfersV355Test-870767852 None] Lock "cinder-quobyte-dddfc546-edc2-493e-9a11-5077a64f6fb7" acquired by "delete_volume" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:27 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[10559c91-5393-40ed-8dad-adb2b3723c67]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-97f9d312-32f4-446b-a895-fbcb9de12772 tempest-VolumesTransfersV355Test-870767852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dddfc546-edc2-493e-9a11-5077a64f6fb7 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:27 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dddfc546-edc2-493e-9a11-5077a64f6fb7 Jul 10 04:48:27 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:28 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-97f9d312-32f4-446b-a895-fbcb9de12772 tempest-VolumesTransfersV355Test-870767852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dddfc546-edc2-493e-9a11-5077a64f6fb7" returned: 0 in 0.740s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-97f9d312-32f4-446b-a895-fbcb9de12772 tempest-VolumesTransfersV355Test-870767852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dddfc546-edc2-493e-9a11-5077a64f6fb7 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:28 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dddfc546-edc2-493e-9a11-5077a64f6fb7 Jul 10 04:48:28 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:29 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-97f9d312-32f4-446b-a895-fbcb9de12772 tempest-VolumesTransfersV355Test-870767852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dddfc546-edc2-493e-9a11-5077a64f6fb7" returned: 0 in 0.648s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-97f9d312-32f4-446b-a895-fbcb9de12772 tempest-VolumesTransfersV355Test-870767852 None] Lock "cinder-quobyte-dddfc546-edc2-493e-9a11-5077a64f6fb7" released by "delete_volume" :: held 1.426s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:29 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-97f9d312-32f4-446b-a895-fbcb9de12772 tempest-VolumesTransfersV355Test-870767852 None] Created reservations ['0d9fc2a2-2796-4520-935e-788e91659e67', 'db9c2099-8792-4d01-9710-423594b79494', 'aa3e57e0-5fd8-4768-a15d-239d653e7bf9', 'd896a529-e10d-4f1e-b7a2-c8123419352a'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:48:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-97f9d312-32f4-446b-a895-fbcb9de12772 tempest-VolumesTransfersV355Test-870767852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-97f9d312-32f4-446b-a895-fbcb9de12772 tempest-VolumesTransfersV355Test-870767852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-97f9d312-32f4-446b-a895-fbcb9de12772 tempest-VolumesTransfersV355Test-870767852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-97f9d312-32f4-446b-a895-fbcb9de12772 tempest-VolumesTransfersV355Test-870767852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-97f9d312-32f4-446b-a895-fbcb9de12772 tempest-VolumesTransfersV355Test-870767852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-97f9d312-32f4-446b-a895-fbcb9de12772 tempest-VolumesTransfersV355Test-870767852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:29 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:48:29 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:29 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-97f9d312-32f4-446b-a895-fbcb9de12772 tempest-VolumesTransfersV355Test-870767852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.645s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:29 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-97f9d312-32f4-446b-a895-fbcb9de12772 tempest-VolumesTransfersV355Test-870767852 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:48:29 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-97f9d312-32f4-446b-a895-fbcb9de12772 tempest-VolumesTransfersV355Test-870767852 None] Deleted volume successfully. Jul 10 04:48:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-97f9d312-32f4-446b-a895-fbcb9de12772 tempest-VolumesTransfersV355Test-870767852 None] Lock "cinder-dddfc546-edc2-493e-9a11-5077a64f6fb7-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:34 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:48:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Flow 'volume_create_manager' (db257e51-3c36-400a-9a88-05fcd3058935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a57a1f-852b-4dd3-a5a3-9ff465f5b8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a57a1f-852b-4dd3-a5a3-9ff465f5b8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1221005004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f30867d-5372-4411-8f59-d598718723a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2742331164524fb094cf39cb01633ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:35Z,use_quota=True,user_id='2ff720784c39420c99c86d67f4e9aa8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6918f43-3ee5-4c82-9210-95df7dc33bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6918f43-3ee5-4c82-9210-95df7dc33bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55a1d66-913d-4b23-a1ce-5d98ef3945b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55a1d66-913d-4b23-a1ce-5d98ef3945b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f30867d-5372-4411-8f59-d598718723a8', 'volume_name': 'volume-7f30867d-5372-4411-8f59-d598718723a8', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89fa05f0-ae5e-4c72-87a0-fa92d34fb531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89fa05f0-ae5e-4c72-87a0-fa92d34fb531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69903f13-f8aa-4345-879c-8c0823315504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:34 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Volume 7f30867d-5372-4411-8f59-d598718723a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f30867d-5372-4411-8f59-d598718723a8', 'volume_size': 1} Jul 10 04:48:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1221005004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f30867d-5372-4411-8f59-d598718723a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2742331164524fb094cf39cb01633ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:35Z,use_quota=True,user_id='2ff720784c39420c99c86d67f4e9aa8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:48:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Creating volume 7f30867d-5372-4411-8f59-d598718723a8 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:48:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:48:34 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:48:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:34 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8 1073741824 Jul 10 04:48:34 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:35 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8 1073741824" returned: 0 in 0.796s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:35 devstack sudo[101227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8 Jul 10 04:48:35 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:36 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8" returned: 0 in 0.643s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:36 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:48:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69903f13-f8aa-4345-879c-8c0823315504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f30867d-5372-4411-8f59-d598718723a8', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4843ff93-356d-4181-8a54-a6ba02341532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:36 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Volume volume-7f30867d-5372-4411-8f59-d598718723a8 (7f30867d-5372-4411-8f59-d598718723a8): created successfully Jul 10 04:48:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4843ff93-356d-4181-8a54-a6ba02341532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Flow 'volume_create_manager' (db257e51-3c36-400a-9a88-05fcd3058935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:36 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d46a0fe0-c19c-4db4-acc8-c430e02ee7e6 tempest-VolumesCloneTest-1139647538 None] Created volume successfully. Jul 10 04:48:37 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:48:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Flow 'volume_create_manager' (485e55da-7b64-4ef3-8148-2bee38b10d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e695a31-8b45-4255-b2bc-e69e19cb0ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e695a31-8b45-4255-b2bc-e69e19cb0ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-134049847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c74edbd5-dbfa-4ce9-8968-50c069497ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2742331164524fb094cf39cb01633ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=7f30867d-5372-4411-8f59-d598718723a8,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:37Z,use_quota=True,user_id='2ff720784c39420c99c86d67f4e9aa8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3348a085-f674-43ae-9c27-ff256c50b866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3348a085-f674-43ae-9c27-ff256c50b866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaeafefc-14df-410a-8af3-3e48da357262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaeafefc-14df-410a-8af3-3e48da357262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c74edbd5-dbfa-4ce9-8968-50c069497ca8', 'volume_name': 'volume-c74edbd5-dbfa-4ce9-8968-50c069497ca8', 'volume_size': 2, 'source_volid': '7f30867d-5372-4411-8f59-d598718723a8', 'source_volstatus': 'available'}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32647c3f-5e7e-47e6-b36a-1db17a1be320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32647c3f-5e7e-47e6-b36a-1db17a1be320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2daeea9-cf36-49ae-987b-fe2ee9e00e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:37 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Volume c74edbd5-dbfa-4ce9-8968-50c069497ca8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c74edbd5-dbfa-4ce9-8968-50c069497ca8', 'volume_size': 2, 'source_volid': '7f30867d-5372-4411-8f59-d598718723a8', 'source_volstatus': 'available'} Jul 10 04:48:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:37 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Cloning volume 7f30867d-5372-4411-8f59-d598718723a8 to volume c74edbd5-dbfa-4ce9-8968-50c069497ca8 Jul 10 04:48:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Creating offline snapshot 8260129a-5194-403a-ab30-45bf75df8c12 of volume 7f30867d-5372-4411-8f59-d598718723a8 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:48:37 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[186ab2a7-c72d-46d1-bf5c-11df434f214f]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:37 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8 Jul 10 04:48:37 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:38 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8" returned: 0 in 0.754s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:38 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12 1G Jul 10 04:48:38 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:38 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12 1G" returned: 0 in 0.759s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f30867d-5372-4411-8f59-d598718723a8 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:39 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f30867d-5372-4411-8f59-d598718723a8 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12 Jul 10 04:48:39 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:39 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f30867d-5372-4411-8f59-d598718723a8 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12" returned: 0 in 0.661s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:39 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12 is being set with open permissions: ugo+rw Jul 10 04:48:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:39 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12 Jul 10 04:48:39 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:40 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12" returned: 0 in 0.609s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:40 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.info Jul 10 04:48:40 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:40 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.info" returned: 0 in 0.615s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:40 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.info is being set with open permissions: ugo+rw Jul 10 04:48:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:40 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.info Jul 10 04:48:40 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:41 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.info" returned: 0 in 0.643s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Acquiring lock "cinder-quobyte-c74edbd5-dbfa-4ce9-8968-50c069497ca8" by "_copy_volume_from_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Lock "cinder-quobyte-c74edbd5-dbfa-4ce9-8968-50c069497ca8" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] snapshot: 8260129a-5194-403a-ab30-45bf75df8c12, volume: c74edbd5-dbfa-4ce9-8968-50c069497ca8, {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 04:48:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:41 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[201e1896-fc14-4d23-be26-0ae7abd4941a]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:41 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12 Jul 10 04:48:41 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:42 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12" returned: 0 in 0.720s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f30867d-5372-4411-8f59-d598718723a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:48:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8 {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 04:48:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Creating direct copy from snapshot {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 04:48:42 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0ae93c-dc9f-4a5b-94c0-696c4f9a6bbd]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:42 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8 Jul 10 04:48:42 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:43 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8" returned: 0 in 0.715s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:43 devstack cinder-volume[87359]: DEBUG cinder.utils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Path /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c74edbd5-dbfa-4ce9-8968-50c069497ca8 not found in is_blk_device check {{(pid=87359) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 04:48:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c74edbd5-dbfa-4ce9-8968-50c069497ca8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:43 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c74edbd5-dbfa-4ce9-8968-50c069497ca8 Jul 10 04:48:43 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:47 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c74edbd5-dbfa-4ce9-8968-50c069497ca8" returned: 0 in 4.494s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:47 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e1bb67-4667-4d59-b7c4-3f7a1fef9e78]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:47 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8 Jul 10 04:48:47 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:48 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8" returned: 0 in 0.909s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:48 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8, size 1024.00 MB, duration 4.50 sec, destination /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c74edbd5-dbfa-4ce9-8968-50c069497ca8 {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:48:48 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Converted 1024.00 MB image at 227.80 MB/s Jul 10 04:48:48 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c74edbd5-dbfa-4ce9-8968-50c069497ca8 is being set with open permissions: ugo+rw Jul 10 04:48:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c74edbd5-dbfa-4ce9-8968-50c069497ca8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:48 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c74edbd5-dbfa-4ce9-8968-50c069497ca8 Jul 10 04:48:48 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:49 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c74edbd5-dbfa-4ce9-8968-50c069497ca8" returned: 0 in 0.599s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:49 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Lock "cinder-quobyte-c74edbd5-dbfa-4ce9-8968-50c069497ca8" released by "_copy_volume_from_snapshot" :: held 7.515s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:49 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Acquiring lock "cinder-quobyte-8260129a-5194-403a-ab30-45bf75df8c12" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:49 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Lock "cinder-quobyte-8260129a-5194-403a-ab30-45bf75df8c12" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Deleting offline snapshot 8260129a-5194-403a-ab30-45bf75df8c12 of volume 7f30867d-5372-4411-8f59-d598718723a8 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:48:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] snapshot_file for this snap is: volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:48:49 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[25be092f-56ad-4f28-b733-51f828a87dbe]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:49 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12 Jul 10 04:48:49 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:49 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12" returned: 0 in 0.713s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f30867d-5372-4411-8f59-d598718723a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:48:49 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e50785-51b5-49c7-af68-dbe57f9f1723]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:49 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8 Jul 10 04:48:49 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:50 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=95,cinder:SELECT=65,cinder:INSERT=36,cinder:DELETE=9 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:48:50 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8" returned: 0 in 0.752s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:50 devstack sudo[101301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12 Jul 10 04:48:50 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:51 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12" returned: 0 in 0.728s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:51 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12 Jul 10 04:48:51 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:52 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8.8260129a-5194-403a-ab30-45bf75df8c12" returned: 0 in 0.647s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Lock "cinder-quobyte-8260129a-5194-403a-ab30-45bf75df8c12" released by "_delete_snapshot" :: held 2.937s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.661s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2daeea9-cf36-49ae-987b-fe2ee9e00e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c74edbd5-dbfa-4ce9-8968-50c069497ca8', 'volume_size': 2, 'source_volid': '7f30867d-5372-4411-8f59-d598718723a8', 'source_volstatus': 'available'}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e66e96-b06b-40fb-8e48-df6ad776257d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:52 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Volume volume-c74edbd5-dbfa-4ce9-8968-50c069497ca8 (c74edbd5-dbfa-4ce9-8968-50c069497ca8): created successfully Jul 10 04:48:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e66e96-b06b-40fb-8e48-df6ad776257d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Flow 'volume_create_manager' (485e55da-7b64-4ef3-8148-2bee38b10d4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:52 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-4bb0541e-791d-430e-b8ca-57ec1cd81285 tempest-VolumesCloneTest-1139647538 None] Created volume successfully. Jul 10 04:48:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-705c3955-b5e3-4f47-a08a-8be181b0e813 tempest-VolumesCloneTest-1139647538 None] Acquiring lock "cinder-c74edbd5-dbfa-4ce9-8968-50c069497ca8-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-705c3955-b5e3-4f47-a08a-8be181b0e813 tempest-VolumesCloneTest-1139647538 None] Lock "cinder-c74edbd5-dbfa-4ce9-8968-50c069497ca8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-705c3955-b5e3-4f47-a08a-8be181b0e813 tempest-VolumesCloneTest-1139647538 None] Acquiring lock "cinder-quobyte-c74edbd5-dbfa-4ce9-8968-50c069497ca8" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-705c3955-b5e3-4f47-a08a-8be181b0e813 tempest-VolumesCloneTest-1139647538 None] Lock "cinder-quobyte-c74edbd5-dbfa-4ce9-8968-50c069497ca8" acquired by "delete_volume" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:52 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[578cd142-b9d7-4003-afcd-d474231fcae0]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-705c3955-b5e3-4f47-a08a-8be181b0e813 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c74edbd5-dbfa-4ce9-8968-50c069497ca8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:52 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c74edbd5-dbfa-4ce9-8968-50c069497ca8 Jul 10 04:48:52 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:53 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-705c3955-b5e3-4f47-a08a-8be181b0e813 tempest-VolumesCloneTest-1139647538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c74edbd5-dbfa-4ce9-8968-50c069497ca8" returned: 0 in 0.731s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-705c3955-b5e3-4f47-a08a-8be181b0e813 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c74edbd5-dbfa-4ce9-8968-50c069497ca8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:53 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c74edbd5-dbfa-4ce9-8968-50c069497ca8 Jul 10 04:48:53 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:53 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-705c3955-b5e3-4f47-a08a-8be181b0e813 tempest-VolumesCloneTest-1139647538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c74edbd5-dbfa-4ce9-8968-50c069497ca8" returned: 0 in 0.652s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-705c3955-b5e3-4f47-a08a-8be181b0e813 tempest-VolumesCloneTest-1139647538 None] Lock "cinder-quobyte-c74edbd5-dbfa-4ce9-8968-50c069497ca8" released by "delete_volume" :: held 1.422s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:54 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:INSERT=20,cinder:UPDATE=88,cinder:SELECT=69,cinder:DELETE=6 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:48:54 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-705c3955-b5e3-4f47-a08a-8be181b0e813 tempest-VolumesCloneTest-1139647538 None] Created reservations ['1025e6ec-de24-4c3c-8af9-99b2cd409ffa', '8a9c8c5f-064c-46d8-99a7-5da8517576ee', '30241092-b0f9-4060-b650-19c1aed57d2b', '260552f3-fe0b-4f48-bbf4-79b46431ce50'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:48:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-705c3955-b5e3-4f47-a08a-8be181b0e813 tempest-VolumesCloneTest-1139647538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-705c3955-b5e3-4f47-a08a-8be181b0e813 tempest-VolumesCloneTest-1139647538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-705c3955-b5e3-4f47-a08a-8be181b0e813 tempest-VolumesCloneTest-1139647538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-705c3955-b5e3-4f47-a08a-8be181b0e813 tempest-VolumesCloneTest-1139647538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-705c3955-b5e3-4f47-a08a-8be181b0e813 tempest-VolumesCloneTest-1139647538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-705c3955-b5e3-4f47-a08a-8be181b0e813 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:54 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:48:54 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:54 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-705c3955-b5e3-4f47-a08a-8be181b0e813 tempest-VolumesCloneTest-1139647538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.614s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:54 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-705c3955-b5e3-4f47-a08a-8be181b0e813 tempest-VolumesCloneTest-1139647538 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:48:54 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-705c3955-b5e3-4f47-a08a-8be181b0e813 tempest-VolumesCloneTest-1139647538 None] Deleted volume successfully. Jul 10 04:48:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-705c3955-b5e3-4f47-a08a-8be181b0e813 tempest-VolumesCloneTest-1139647538 None] Lock "cinder-c74edbd5-dbfa-4ce9-8968-50c069497ca8-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-12e7f15c-94ca-43e8-aaaf-0fb7e3adc104 tempest-VolumesCloneTest-1139647538 None] Acquiring lock "cinder-7f30867d-5372-4411-8f59-d598718723a8-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-12e7f15c-94ca-43e8-aaaf-0fb7e3adc104 tempest-VolumesCloneTest-1139647538 None] Lock "cinder-7f30867d-5372-4411-8f59-d598718723a8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-12e7f15c-94ca-43e8-aaaf-0fb7e3adc104 tempest-VolumesCloneTest-1139647538 None] Acquiring lock "cinder-quobyte-7f30867d-5372-4411-8f59-d598718723a8" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-12e7f15c-94ca-43e8-aaaf-0fb7e3adc104 tempest-VolumesCloneTest-1139647538 None] Lock "cinder-quobyte-7f30867d-5372-4411-8f59-d598718723a8" acquired by "delete_volume" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:54 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b32017e-d89b-477e-9a44-b5a23ca5e881]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-12e7f15c-94ca-43e8-aaaf-0fb7e3adc104 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:54 devstack sudo[101321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8 Jul 10 04:48:54 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:55 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-12e7f15c-94ca-43e8-aaaf-0fb7e3adc104 tempest-VolumesCloneTest-1139647538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8" returned: 0 in 0.764s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-12e7f15c-94ca-43e8-aaaf-0fb7e3adc104 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:55 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8 Jul 10 04:48:55 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:56 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-12e7f15c-94ca-43e8-aaaf-0fb7e3adc104 tempest-VolumesCloneTest-1139647538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7f30867d-5372-4411-8f59-d598718723a8" returned: 0 in 0.629s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-12e7f15c-94ca-43e8-aaaf-0fb7e3adc104 tempest-VolumesCloneTest-1139647538 None] Lock "cinder-quobyte-7f30867d-5372-4411-8f59-d598718723a8" released by "delete_volume" :: held 1.449s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:56 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-12e7f15c-94ca-43e8-aaaf-0fb7e3adc104 tempest-VolumesCloneTest-1139647538 None] Created reservations ['dbdf93da-7dcd-441c-81d7-69ebf683a0e1', '8cc35fa7-978a-476e-914c-359beb1b5c32', 'd7e45f74-a227-4157-a262-d53767155335', 'cf529bca-eb5f-428c-9892-42741263999d'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:48:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-12e7f15c-94ca-43e8-aaaf-0fb7e3adc104 tempest-VolumesCloneTest-1139647538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-12e7f15c-94ca-43e8-aaaf-0fb7e3adc104 tempest-VolumesCloneTest-1139647538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-12e7f15c-94ca-43e8-aaaf-0fb7e3adc104 tempest-VolumesCloneTest-1139647538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-12e7f15c-94ca-43e8-aaaf-0fb7e3adc104 tempest-VolumesCloneTest-1139647538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-12e7f15c-94ca-43e8-aaaf-0fb7e3adc104 tempest-VolumesCloneTest-1139647538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-12e7f15c-94ca-43e8-aaaf-0fb7e3adc104 tempest-VolumesCloneTest-1139647538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:56 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:48:56 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:57 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-12e7f15c-94ca-43e8-aaaf-0fb7e3adc104 tempest-VolumesCloneTest-1139647538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.637s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:57 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-12e7f15c-94ca-43e8-aaaf-0fb7e3adc104 tempest-VolumesCloneTest-1139647538 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:48:57 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-12e7f15c-94ca-43e8-aaaf-0fb7e3adc104 tempest-VolumesCloneTest-1139647538 None] Deleted volume successfully. Jul 10 04:48:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-12e7f15c-94ca-43e8-aaaf-0fb7e3adc104 tempest-VolumesCloneTest-1139647538 None] Lock "cinder-7f30867d-5372-4411-8f59-d598718723a8-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:59 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:48:59 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Flow 'volume_create_manager' (2cfd4ea2-dda8-41ab-a3a8-564c7b3dd794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:59 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139e303b-635f-461c-93c6-062c76d45e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:59 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139e303b-635f-461c-93c6-062c76d45e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-60089540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe60051b-18e7-4057-a840-1f6c82a4394f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f63b399dd2f740aba9898dec4e68de1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:00Z,use_quota=True,user_id='947bf09ff660431f886c2937355c8b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:59 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b56b80-3b64-457f-8857-45402dda0ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:59 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b56b80-3b64-457f-8857-45402dda0ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:59 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4e29db-ac74-484a-90fc-99d8947a2319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:59 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4e29db-ac74-484a-90fc-99d8947a2319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe60051b-18e7-4057-a840-1f6c82a4394f', 'volume_name': 'volume-fe60051b-18e7-4057-a840-1f6c82a4394f', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:59 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8140d0-f343-4bd0-9cc5-220bc6610ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:59 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8140d0-f343-4bd0-9cc5-220bc6610ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:59 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f842b470-8c17-402d-8f4f-816710c995fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:59 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Volume fe60051b-18e7-4057-a840-1f6c82a4394f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe60051b-18e7-4057-a840-1f6c82a4394f', 'volume_size': 1} Jul 10 04:48:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:59 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-60089540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe60051b-18e7-4057-a840-1f6c82a4394f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f63b399dd2f740aba9898dec4e68de1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:00Z,use_quota=True,user_id='947bf09ff660431f886c2937355c8b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:48:59 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Creating volume fe60051b-18e7-4057-a840-1f6c82a4394f {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:48:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:59 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:59 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:59 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:48:59 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:48:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fe60051b-18e7-4057-a840-1f6c82a4394f 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:59 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fe60051b-18e7-4057-a840-1f6c82a4394f 1073741824 Jul 10 04:48:59 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:00 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fe60051b-18e7-4057-a840-1f6c82a4394f 1073741824" returned: 0 in 0.769s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fe60051b-18e7-4057-a840-1f6c82a4394f {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:00 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fe60051b-18e7-4057-a840-1f6c82a4394f Jul 10 04:49:00 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:01 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fe60051b-18e7-4057-a840-1f6c82a4394f" returned: 0 in 0.662s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:49:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f842b470-8c17-402d-8f4f-816710c995fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe60051b-18e7-4057-a840-1f6c82a4394f', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7caaa3a-f1e0-4452-9d13-d85dadce44c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:01 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Volume volume-fe60051b-18e7-4057-a840-1f6c82a4394f (fe60051b-18e7-4057-a840-1f6c82a4394f): created successfully Jul 10 04:49:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7caaa3a-f1e0-4452-9d13-d85dadce44c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Flow 'volume_create_manager' (2cfd4ea2-dda8-41ab-a3a8-564c7b3dd794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:01 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-3251e12c-ea65-4b37-b56a-e582e7127ccd tempest-VolumesGetTest-645765861 None] Created volume successfully. Jul 10 04:49:02 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:49:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Flow 'volume_create_manager' (d65b8a48-0d4f-4161-81a3-afd6db225515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c5349b-344b-4266-9fb0-8555a40fb8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c5349b-344b-4266-9fb0-8555a40fb8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-113111119',display_name='tempest-VolumesGetTest-Volume-972074104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0450298c-86c8-4eaf-8c3a-7680e5662d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63b399dd2f740aba9898dec4e68de1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:02Z,use_quota=True,user_id='947bf09ff660431f886c2937355c8b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8bdc14-31ba-4029-8f88-f252eb3c84b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8bdc14-31ba-4029-8f88-f252eb3c84b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405bb265-021a-43e2-a477-b721a80acf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405bb265-021a-43e2-a477-b721a80acf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0450298c-86c8-4eaf-8c3a-7680e5662d1c', 'volume_name': 'volume-0450298c-86c8-4eaf-8c3a-7680e5662d1c', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ac5639-4581-4013-8541-71291b9a5b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ac5639-4581-4013-8541-71291b9a5b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3c0adb-be2f-45d9-85db-afa9736c379c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:02 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Volume 0450298c-86c8-4eaf-8c3a-7680e5662d1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0450298c-86c8-4eaf-8c3a-7680e5662d1c', 'volume_size': 1} Jul 10 04:49:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-113111119',display_name='tempest-VolumesGetTest-Volume-972074104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0450298c-86c8-4eaf-8c3a-7680e5662d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63b399dd2f740aba9898dec4e68de1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:02Z,use_quota=True,user_id='947bf09ff660431f886c2937355c8b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:49:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Creating volume 0450298c-86c8-4eaf-8c3a-7680e5662d1c {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:49:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:49:02 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:49:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0450298c-86c8-4eaf-8c3a-7680e5662d1c 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:02 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0450298c-86c8-4eaf-8c3a-7680e5662d1c 1073741824 Jul 10 04:49:02 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:03 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0450298c-86c8-4eaf-8c3a-7680e5662d1c 1073741824" returned: 0 in 0.799s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0450298c-86c8-4eaf-8c3a-7680e5662d1c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:03 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0450298c-86c8-4eaf-8c3a-7680e5662d1c Jul 10 04:49:03 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:03 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0450298c-86c8-4eaf-8c3a-7680e5662d1c" returned: 0 in 0.612s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:49:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3c0adb-be2f-45d9-85db-afa9736c379c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0450298c-86c8-4eaf-8c3a-7680e5662d1c', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a5fff0-3c42-42e6-87bf-d7397f98cf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:03 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Volume volume-0450298c-86c8-4eaf-8c3a-7680e5662d1c (0450298c-86c8-4eaf-8c3a-7680e5662d1c): created successfully Jul 10 04:49:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a5fff0-3c42-42e6-87bf-d7397f98cf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Flow 'volume_create_manager' (d65b8a48-0d4f-4161-81a3-afd6db225515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:03 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-854f22b8-fb96-433b-ba50-b5d8cadd29ce tempest-VolumesGetTest-645765861 None] Created volume successfully. Jul 10 04:49:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2dd8e68c-4da4-469c-a17d-6fc83a767e72 tempest-VolumesGetTest-645765861 None] Acquiring lock "cinder-0450298c-86c8-4eaf-8c3a-7680e5662d1c-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2dd8e68c-4da4-469c-a17d-6fc83a767e72 tempest-VolumesGetTest-645765861 None] Lock "cinder-0450298c-86c8-4eaf-8c3a-7680e5662d1c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2dd8e68c-4da4-469c-a17d-6fc83a767e72 tempest-VolumesGetTest-645765861 None] Acquiring lock "cinder-quobyte-0450298c-86c8-4eaf-8c3a-7680e5662d1c" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2dd8e68c-4da4-469c-a17d-6fc83a767e72 tempest-VolumesGetTest-645765861 None] Lock "cinder-quobyte-0450298c-86c8-4eaf-8c3a-7680e5662d1c" acquired by "delete_volume" :: waited 0.013s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:04 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96d553c-aaa0-4bd6-90f8-204fa970bf7e]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2dd8e68c-4da4-469c-a17d-6fc83a767e72 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0450298c-86c8-4eaf-8c3a-7680e5662d1c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:04 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0450298c-86c8-4eaf-8c3a-7680e5662d1c Jul 10 04:49:04 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:05 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2dd8e68c-4da4-469c-a17d-6fc83a767e72 tempest-VolumesGetTest-645765861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0450298c-86c8-4eaf-8c3a-7680e5662d1c" returned: 0 in 0.726s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2dd8e68c-4da4-469c-a17d-6fc83a767e72 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0450298c-86c8-4eaf-8c3a-7680e5662d1c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:05 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0450298c-86c8-4eaf-8c3a-7680e5662d1c Jul 10 04:49:05 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:05 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2dd8e68c-4da4-469c-a17d-6fc83a767e72 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0450298c-86c8-4eaf-8c3a-7680e5662d1c" returned: 0 in 0.636s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2dd8e68c-4da4-469c-a17d-6fc83a767e72 tempest-VolumesGetTest-645765861 None] Lock "cinder-quobyte-0450298c-86c8-4eaf-8c3a-7680e5662d1c" released by "delete_volume" :: held 1.402s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:06 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-2dd8e68c-4da4-469c-a17d-6fc83a767e72 tempest-VolumesGetTest-645765861 None] Created reservations ['d0b9a78b-e190-4495-9073-cce9e8418380', '155052b6-1305-4ecd-b464-520afdef9bb7', 'd8dfdfb6-908b-4970-8ebb-22c58e044673', 'a55f393a-814c-4f04-bdf8-0ef6df9e1466'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:49:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2dd8e68c-4da4-469c-a17d-6fc83a767e72 tempest-VolumesGetTest-645765861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2dd8e68c-4da4-469c-a17d-6fc83a767e72 tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2dd8e68c-4da4-469c-a17d-6fc83a767e72 tempest-VolumesGetTest-645765861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2dd8e68c-4da4-469c-a17d-6fc83a767e72 tempest-VolumesGetTest-645765861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2dd8e68c-4da4-469c-a17d-6fc83a767e72 tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2dd8e68c-4da4-469c-a17d-6fc83a767e72 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:06 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:49:06 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:06 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2dd8e68c-4da4-469c-a17d-6fc83a767e72 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.611s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:06 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-2dd8e68c-4da4-469c-a17d-6fc83a767e72 tempest-VolumesGetTest-645765861 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:49:06 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-2dd8e68c-4da4-469c-a17d-6fc83a767e72 tempest-VolumesGetTest-645765861 None] Deleted volume successfully. Jul 10 04:49:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2dd8e68c-4da4-469c-a17d-6fc83a767e72 tempest-VolumesGetTest-645765861 None] Lock "cinder-0450298c-86c8-4eaf-8c3a-7680e5662d1c-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d7f4fb14-c17e-4f89-b506-66d94be32917 tempest-VolumesGetTest-645765861 None] Acquiring lock "cinder-fe60051b-18e7-4057-a840-1f6c82a4394f-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d7f4fb14-c17e-4f89-b506-66d94be32917 tempest-VolumesGetTest-645765861 None] Lock "cinder-fe60051b-18e7-4057-a840-1f6c82a4394f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d7f4fb14-c17e-4f89-b506-66d94be32917 tempest-VolumesGetTest-645765861 None] Acquiring lock "cinder-quobyte-fe60051b-18e7-4057-a840-1f6c82a4394f" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d7f4fb14-c17e-4f89-b506-66d94be32917 tempest-VolumesGetTest-645765861 None] Lock "cinder-quobyte-fe60051b-18e7-4057-a840-1f6c82a4394f" acquired by "delete_volume" :: waited 0.013s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:06 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c92ed2-1f7e-44e7-a058-801a6760c703]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d7f4fb14-c17e-4f89-b506-66d94be32917 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fe60051b-18e7-4057-a840-1f6c82a4394f {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:07 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fe60051b-18e7-4057-a840-1f6c82a4394f Jul 10 04:49:07 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:07 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d7f4fb14-c17e-4f89-b506-66d94be32917 tempest-VolumesGetTest-645765861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fe60051b-18e7-4057-a840-1f6c82a4394f" returned: 0 in 0.769s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d7f4fb14-c17e-4f89-b506-66d94be32917 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fe60051b-18e7-4057-a840-1f6c82a4394f {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:07 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fe60051b-18e7-4057-a840-1f6c82a4394f Jul 10 04:49:07 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:08 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d7f4fb14-c17e-4f89-b506-66d94be32917 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-fe60051b-18e7-4057-a840-1f6c82a4394f" returned: 0 in 0.630s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d7f4fb14-c17e-4f89-b506-66d94be32917 tempest-VolumesGetTest-645765861 None] Lock "cinder-quobyte-fe60051b-18e7-4057-a840-1f6c82a4394f" released by "delete_volume" :: held 1.436s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:08 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-d7f4fb14-c17e-4f89-b506-66d94be32917 tempest-VolumesGetTest-645765861 None] Created reservations ['7d46af6f-c229-4b43-986c-9e4a62b558f6', '077e5dd1-c0b2-4ae2-8ec4-c0d2618646fc', 'af69041e-665d-4920-ad1f-ca54d1e0079a', '320e0844-385d-4f88-9aa5-3f0b2ed944fb'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:49:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d7f4fb14-c17e-4f89-b506-66d94be32917 tempest-VolumesGetTest-645765861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d7f4fb14-c17e-4f89-b506-66d94be32917 tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d7f4fb14-c17e-4f89-b506-66d94be32917 tempest-VolumesGetTest-645765861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d7f4fb14-c17e-4f89-b506-66d94be32917 tempest-VolumesGetTest-645765861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d7f4fb14-c17e-4f89-b506-66d94be32917 tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d7f4fb14-c17e-4f89-b506-66d94be32917 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:08 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:49:08 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:09 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d7f4fb14-c17e-4f89-b506-66d94be32917 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.671s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-d7f4fb14-c17e-4f89-b506-66d94be32917 tempest-VolumesGetTest-645765861 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:49:09 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d7f4fb14-c17e-4f89-b506-66d94be32917 tempest-VolumesGetTest-645765861 None] Deleted volume successfully. Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d7f4fb14-c17e-4f89-b506-66d94be32917 tempest-VolumesGetTest-645765861 None] Lock "cinder-fe60051b-18e7-4057-a840-1f6c82a4394f-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Flow 'volume_create_manager' (50934174-5083-4270-9850-218d5acebfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5601b368-d6f7-408d-bfe3-0c9968295848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5601b368-d6f7-408d-bfe3-0c9968295848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2089092861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b195cb-3f37-49d9-9b80-dbc69b14128b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63b399dd2f740aba9898dec4e68de1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:09Z,use_quota=True,user_id='947bf09ff660431f886c2937355c8b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2241cd-45d3-42f3-9f36-31c4b5532ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2241cd-45d3-42f3-9f36-31c4b5532ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d4749d-9de3-413e-8b4f-151c29bc4d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d4749d-9de3-413e-8b4f-151c29bc4d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66b195cb-3f37-49d9-9b80-dbc69b14128b', 'volume_name': 'volume-66b195cb-3f37-49d9-9b80-dbc69b14128b', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e17fa4c-875d-4e62-a8f8-7e345af3a401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e17fa4c-875d-4e62-a8f8-7e345af3a401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66e162d-d0a4-4dfb-8312-f627002d423d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:09 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Volume 66b195cb-3f37-49d9-9b80-dbc69b14128b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66b195cb-3f37-49d9-9b80-dbc69b14128b', 'volume_size': 1} Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2089092861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b195cb-3f37-49d9-9b80-dbc69b14128b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63b399dd2f740aba9898dec4e68de1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:09Z,use_quota=True,user_id='947bf09ff660431f886c2937355c8b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Creating volume 66b195cb-3f37-49d9-9b80-dbc69b14128b {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:49:09 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:49:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:09 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b 1073741824 Jul 10 04:49:09 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:10 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b 1073741824" returned: 0 in 0.801s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:10 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b Jul 10 04:49:10 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:11 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b" returned: 0 in 0.609s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:11 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:49:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66e162d-d0a4-4dfb-8312-f627002d423d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b195cb-3f37-49d9-9b80-dbc69b14128b', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd85251-0333-4d8b-9df2-2a031a1def53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:11 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Volume volume-66b195cb-3f37-49d9-9b80-dbc69b14128b (66b195cb-3f37-49d9-9b80-dbc69b14128b): created successfully Jul 10 04:49:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd85251-0333-4d8b-9df2-2a031a1def53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Flow 'volume_create_manager' (50934174-5083-4270-9850-218d5acebfe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:11 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ac1a6417-0710-4c73-9f5b-19bd212d1d9b tempest-VolumesGetTest-645765861 None] Created volume successfully. Jul 10 04:49:12 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:49:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Flow 'volume_create_manager' (07057853-cd6d-4cc6-8189-cda45f1b2678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db166a0-7731-4ebc-9398-9d0d65925f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db166a0-7731-4ebc-9398-9d0d65925f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-278692334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=379beac4-5e53-499c-8ba5-0337e88d7fef,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f63b399dd2f740aba9898dec4e68de1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=66b195cb-3f37-49d9-9b80-dbc69b14128b,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:12Z,use_quota=True,user_id='947bf09ff660431f886c2937355c8b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07be36eb-e793-432d-9a80-7fa1372481b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07be36eb-e793-432d-9a80-7fa1372481b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b156041-4d59-4948-9b49-2eef4eb22a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b156041-4d59-4948-9b49-2eef4eb22a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '379beac4-5e53-499c-8ba5-0337e88d7fef', 'volume_name': 'volume-379beac4-5e53-499c-8ba5-0337e88d7fef', 'volume_size': 1, 'source_volid': '66b195cb-3f37-49d9-9b80-dbc69b14128b', 'source_volstatus': 'available'}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d16054-e184-4cf8-841d-b155934f277b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d16054-e184-4cf8-841d-b155934f277b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f1d62af-c456-4fb1-baea-2ae9c6a22909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:12 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Volume 379beac4-5e53-499c-8ba5-0337e88d7fef: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-379beac4-5e53-499c-8ba5-0337e88d7fef', 'volume_size': 1, 'source_volid': '66b195cb-3f37-49d9-9b80-dbc69b14128b', 'source_volstatus': 'available'} Jul 10 04:49:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:12 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Cloning volume 66b195cb-3f37-49d9-9b80-dbc69b14128b to volume 379beac4-5e53-499c-8ba5-0337e88d7fef Jul 10 04:49:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Creating offline snapshot 840e7f55-4f84-4fbd-bd68-3dd54b067bea of volume 66b195cb-3f37-49d9-9b80-dbc69b14128b {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:49:12 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ef3718-65c6-420a-a600-73f6c990e19d]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:12 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b Jul 10 04:49:12 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:12 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b" returned: 0 in 0.749s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:12 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea 1G Jul 10 04:49:12 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:13 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea 1G" returned: 0 in 0.761s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66b195cb-3f37-49d9-9b80-dbc69b14128b -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:13 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66b195cb-3f37-49d9-9b80-dbc69b14128b -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea Jul 10 04:49:13 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:14 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66b195cb-3f37-49d9-9b80-dbc69b14128b -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea" returned: 0 in 0.653s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:14 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea is being set with open permissions: ugo+rw Jul 10 04:49:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:14 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea Jul 10 04:49:14 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:14 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea" returned: 0 in 0.636s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:15 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.info Jul 10 04:49:15 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:15 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.info" returned: 0 in 0.632s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:15 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.info is being set with open permissions: ugo+rw Jul 10 04:49:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:15 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.info Jul 10 04:49:15 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:49:15 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:49:15 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:49:16 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.info" returned: 0 in 0.615s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:16 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Acquiring lock "cinder-quobyte-379beac4-5e53-499c-8ba5-0337e88d7fef" by "_copy_volume_from_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:16 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Lock "cinder-quobyte-379beac4-5e53-499c-8ba5-0337e88d7fef" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:16 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] snapshot: 840e7f55-4f84-4fbd-bd68-3dd54b067bea, volume: 379beac4-5e53-499c-8ba5-0337e88d7fef, {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 04:49:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:16 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:16 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:16 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28ac8f2-8c32-43da-be50-1b9e4994d643]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:16 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea Jul 10 04:49:16 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:17 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea" returned: 0 in 0.720s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66b195cb-3f37-49d9-9b80-dbc69b14128b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:49:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 04:49:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Creating direct copy from snapshot {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 04:49:17 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd66910f-c19a-453c-a797-de052c66527c]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:17 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b Jul 10 04:49:17 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:17 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b" returned: 0 in 0.745s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:17 devstack cinder-volume[87359]: DEBUG cinder.utils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Path /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-379beac4-5e53-499c-8ba5-0337e88d7fef not found in is_blk_device check {{(pid=87359) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 04:49:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-379beac4-5e53-499c-8ba5-0337e88d7fef {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:17 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-379beac4-5e53-499c-8ba5-0337e88d7fef Jul 10 04:49:17 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:22 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-379beac4-5e53-499c-8ba5-0337e88d7fef" returned: 0 in 4.300s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:22 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a26cad-88f1-48bb-8f1c-c0a056ee995f]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:22 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b Jul 10 04:49:22 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:23 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b" returned: 0 in 0.977s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:23 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b, size 1024.00 MB, duration 4.30 sec, destination /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-379beac4-5e53-499c-8ba5-0337e88d7fef {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:49:23 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Converted 1024.00 MB image at 238.07 MB/s Jul 10 04:49:23 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-379beac4-5e53-499c-8ba5-0337e88d7fef is being set with open permissions: ugo+rw Jul 10 04:49:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-379beac4-5e53-499c-8ba5-0337e88d7fef {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:23 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-379beac4-5e53-499c-8ba5-0337e88d7fef Jul 10 04:49:23 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:23 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-379beac4-5e53-499c-8ba5-0337e88d7fef" returned: 0 in 0.613s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:23 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Lock "cinder-quobyte-379beac4-5e53-499c-8ba5-0337e88d7fef" released by "_copy_volume_from_snapshot" :: held 7.427s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:23 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Acquiring lock "cinder-quobyte-840e7f55-4f84-4fbd-bd68-3dd54b067bea" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:23 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Lock "cinder-quobyte-840e7f55-4f84-4fbd-bd68-3dd54b067bea" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:23 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Deleting offline snapshot 840e7f55-4f84-4fbd-bd68-3dd54b067bea of volume 66b195cb-3f37-49d9-9b80-dbc69b14128b {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:49:23 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] snapshot_file for this snap is: volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:49:23 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[057696e3-ec25-46d1-a8fd-7b2b39be797e]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:23 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea Jul 10 04:49:23 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:24 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea" returned: 0 in 0.724s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66b195cb-3f37-49d9-9b80-dbc69b14128b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:49:24 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[d961a9c7-ec68-4a6b-8b7a-9382aeef715f]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:24 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b Jul 10 04:49:24 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:24 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=47,cinder:SELECT=32,cinder:DELETE=2,cinder:INSERT=13 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:49:25 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b" returned: 0 in 0.725s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:25 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea Jul 10 04:49:25 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:25 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea" returned: 0 in 0.707s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:25 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea Jul 10 04:49:25 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:26 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b.840e7f55-4f84-4fbd-bd68-3dd54b067bea" returned: 0 in 0.625s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:26 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Lock "cinder-quobyte-840e7f55-4f84-4fbd-bd68-3dd54b067bea" released by "_delete_snapshot" :: held 2.861s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.502s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f1d62af-c456-4fb1-baea-2ae9c6a22909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-379beac4-5e53-499c-8ba5-0337e88d7fef', 'volume_size': 1, 'source_volid': '66b195cb-3f37-49d9-9b80-dbc69b14128b', 'source_volstatus': 'available'}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d148a2a-5d36-45d1-a6c3-c854236db74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:26 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Volume volume-379beac4-5e53-499c-8ba5-0337e88d7fef (379beac4-5e53-499c-8ba5-0337e88d7fef): created successfully Jul 10 04:49:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d148a2a-5d36-45d1-a6c3-c854236db74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Flow 'volume_create_manager' (07057853-cd6d-4cc6-8189-cda45f1b2678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:26 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-9d2eb9a3-0e12-4966-b3ae-c9d60562c517 tempest-VolumesGetTest-645765861 None] Created volume successfully. Jul 10 04:49:27 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:49:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Flow 'volume_create_manager' (30f6bb17-8afa-4a87-9e97-057574676446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389e90be-194c-4e87-bddf-f313a5dc4eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389e90be-194c-4e87-bddf-f313a5dc4eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2146069152',display_name='tempest-VolumesGetTest-Volume-1726740750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e23c9c9-70ae-4c1b-932f-e39b7f517c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63b399dd2f740aba9898dec4e68de1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:28Z,use_quota=True,user_id='947bf09ff660431f886c2937355c8b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf4f8bb-4cd9-4f28-969f-7fc35bafb6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf4f8bb-4cd9-4f28-969f-7fc35bafb6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913fe287-5a2c-4fac-9fd8-1f78580f348e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913fe287-5a2c-4fac-9fd8-1f78580f348e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e23c9c9-70ae-4c1b-932f-e39b7f517c7a', 'volume_name': 'volume-2e23c9c9-70ae-4c1b-932f-e39b7f517c7a', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc14887e-0878-4928-9232-9e5bc87f70c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc14887e-0878-4928-9232-9e5bc87f70c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a680c5-1f46-4b13-ab0f-7034819ad5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:27 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Volume 2e23c9c9-70ae-4c1b-932f-e39b7f517c7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e23c9c9-70ae-4c1b-932f-e39b7f517c7a', 'volume_size': 1} Jul 10 04:49:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2146069152',display_name='tempest-VolumesGetTest-Volume-1726740750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e23c9c9-70ae-4c1b-932f-e39b7f517c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63b399dd2f740aba9898dec4e68de1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:28Z,use_quota=True,user_id='947bf09ff660431f886c2937355c8b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:49:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Creating volume 2e23c9c9-70ae-4c1b-932f-e39b7f517c7a {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:49:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:49:27 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:49:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2e23c9c9-70ae-4c1b-932f-e39b7f517c7a 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:27 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2e23c9c9-70ae-4c1b-932f-e39b7f517c7a 1073741824 Jul 10 04:49:27 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:28 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2e23c9c9-70ae-4c1b-932f-e39b7f517c7a 1073741824" returned: 0 in 0.775s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2e23c9c9-70ae-4c1b-932f-e39b7f517c7a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:28 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2e23c9c9-70ae-4c1b-932f-e39b7f517c7a Jul 10 04:49:28 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:29 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2e23c9c9-70ae-4c1b-932f-e39b7f517c7a" returned: 0 in 0.609s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:49:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a680c5-1f46-4b13-ab0f-7034819ad5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e23c9c9-70ae-4c1b-932f-e39b7f517c7a', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b677808c-1d55-41c7-8061-747584f84ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:29 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Volume volume-2e23c9c9-70ae-4c1b-932f-e39b7f517c7a (2e23c9c9-70ae-4c1b-932f-e39b7f517c7a): created successfully Jul 10 04:49:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b677808c-1d55-41c7-8061-747584f84ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Flow 'volume_create_manager' (30f6bb17-8afa-4a87-9e97-057574676446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:29 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-12a3b618-a302-4efd-a18a-762dcc09302f tempest-VolumesGetTest-645765861 None] Created volume successfully. Jul 10 04:49:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cb2c9f1e-aebe-4ffb-af6c-8efe733a6bb8 tempest-VolumesGetTest-645765861 None] Acquiring lock "cinder-2e23c9c9-70ae-4c1b-932f-e39b7f517c7a-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cb2c9f1e-aebe-4ffb-af6c-8efe733a6bb8 tempest-VolumesGetTest-645765861 None] Lock "cinder-2e23c9c9-70ae-4c1b-932f-e39b7f517c7a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cb2c9f1e-aebe-4ffb-af6c-8efe733a6bb8 tempest-VolumesGetTest-645765861 None] Acquiring lock "cinder-quobyte-2e23c9c9-70ae-4c1b-932f-e39b7f517c7a" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cb2c9f1e-aebe-4ffb-af6c-8efe733a6bb8 tempest-VolumesGetTest-645765861 None] Lock "cinder-quobyte-2e23c9c9-70ae-4c1b-932f-e39b7f517c7a" acquired by "delete_volume" :: waited 0.013s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:29 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[782dbc1a-2787-4f24-bea6-4db7c51b3680]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cb2c9f1e-aebe-4ffb-af6c-8efe733a6bb8 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2e23c9c9-70ae-4c1b-932f-e39b7f517c7a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:30 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2e23c9c9-70ae-4c1b-932f-e39b7f517c7a Jul 10 04:49:30 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:30 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cb2c9f1e-aebe-4ffb-af6c-8efe733a6bb8 tempest-VolumesGetTest-645765861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2e23c9c9-70ae-4c1b-932f-e39b7f517c7a" returned: 0 in 0.725s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cb2c9f1e-aebe-4ffb-af6c-8efe733a6bb8 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2e23c9c9-70ae-4c1b-932f-e39b7f517c7a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:30 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2e23c9c9-70ae-4c1b-932f-e39b7f517c7a Jul 10 04:49:30 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:31 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cb2c9f1e-aebe-4ffb-af6c-8efe733a6bb8 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-2e23c9c9-70ae-4c1b-932f-e39b7f517c7a" returned: 0 in 0.615s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:31 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cb2c9f1e-aebe-4ffb-af6c-8efe733a6bb8 tempest-VolumesGetTest-645765861 None] Lock "cinder-quobyte-2e23c9c9-70ae-4c1b-932f-e39b7f517c7a" released by "delete_volume" :: held 1.375s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:31 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-cb2c9f1e-aebe-4ffb-af6c-8efe733a6bb8 tempest-VolumesGetTest-645765861 None] Created reservations ['924c569d-852b-420d-95f8-eaaffab84d61', 'edf488a7-e3f0-46ea-a003-3214ab7987ee', '3dc3f592-e3b3-448d-819d-ea752ed6ff79', '5da7acaa-703e-4831-94eb-dc42956732ce'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:49:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-cb2c9f1e-aebe-4ffb-af6c-8efe733a6bb8 tempest-VolumesGetTest-645765861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-cb2c9f1e-aebe-4ffb-af6c-8efe733a6bb8 tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:31 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-cb2c9f1e-aebe-4ffb-af6c-8efe733a6bb8 tempest-VolumesGetTest-645765861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:31 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-cb2c9f1e-aebe-4ffb-af6c-8efe733a6bb8 tempest-VolumesGetTest-645765861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-cb2c9f1e-aebe-4ffb-af6c-8efe733a6bb8 tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cb2c9f1e-aebe-4ffb-af6c-8efe733a6bb8 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:31 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:49:31 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:32 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cb2c9f1e-aebe-4ffb-af6c-8efe733a6bb8 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.614s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:32 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-cb2c9f1e-aebe-4ffb-af6c-8efe733a6bb8 tempest-VolumesGetTest-645765861 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:49:32 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-cb2c9f1e-aebe-4ffb-af6c-8efe733a6bb8 tempest-VolumesGetTest-645765861 None] Deleted volume successfully. Jul 10 04:49:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cb2c9f1e-aebe-4ffb-af6c-8efe733a6bb8 tempest-VolumesGetTest-645765861 None] Lock "cinder-2e23c9c9-70ae-4c1b-932f-e39b7f517c7a-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d9bf345e-6a61-4852-ae2b-a8a2f4e050cd tempest-VolumesGetTest-645765861 None] Acquiring lock "cinder-379beac4-5e53-499c-8ba5-0337e88d7fef-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d9bf345e-6a61-4852-ae2b-a8a2f4e050cd tempest-VolumesGetTest-645765861 None] Lock "cinder-379beac4-5e53-499c-8ba5-0337e88d7fef-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d9bf345e-6a61-4852-ae2b-a8a2f4e050cd tempest-VolumesGetTest-645765861 None] Acquiring lock "cinder-quobyte-379beac4-5e53-499c-8ba5-0337e88d7fef" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d9bf345e-6a61-4852-ae2b-a8a2f4e050cd tempest-VolumesGetTest-645765861 None] Lock "cinder-quobyte-379beac4-5e53-499c-8ba5-0337e88d7fef" acquired by "delete_volume" :: waited 0.029s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:32 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[950bd1fd-ddaa-4b92-9661-567fede3c9dd]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d9bf345e-6a61-4852-ae2b-a8a2f4e050cd tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-379beac4-5e53-499c-8ba5-0337e88d7fef {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:32 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-379beac4-5e53-499c-8ba5-0337e88d7fef Jul 10 04:49:32 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:33 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d9bf345e-6a61-4852-ae2b-a8a2f4e050cd tempest-VolumesGetTest-645765861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-379beac4-5e53-499c-8ba5-0337e88d7fef" returned: 0 in 0.730s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d9bf345e-6a61-4852-ae2b-a8a2f4e050cd tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-379beac4-5e53-499c-8ba5-0337e88d7fef {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:33 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-379beac4-5e53-499c-8ba5-0337e88d7fef Jul 10 04:49:33 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:33 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d9bf345e-6a61-4852-ae2b-a8a2f4e050cd tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-379beac4-5e53-499c-8ba5-0337e88d7fef" returned: 0 in 0.614s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d9bf345e-6a61-4852-ae2b-a8a2f4e050cd tempest-VolumesGetTest-645765861 None] Lock "cinder-quobyte-379beac4-5e53-499c-8ba5-0337e88d7fef" released by "delete_volume" :: held 1.385s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:33 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-d9bf345e-6a61-4852-ae2b-a8a2f4e050cd tempest-VolumesGetTest-645765861 None] Created reservations ['bee5a52f-d68b-47d3-8b09-0f710f9d0119', '45443892-03a1-42a4-be59-8f2424fe5c5b', '8398d537-d66e-4bec-8d78-d12869150e34', '9b9222f1-dd51-44ee-b1b4-c43e98c5af60'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:49:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d9bf345e-6a61-4852-ae2b-a8a2f4e050cd tempest-VolumesGetTest-645765861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d9bf345e-6a61-4852-ae2b-a8a2f4e050cd tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d9bf345e-6a61-4852-ae2b-a8a2f4e050cd tempest-VolumesGetTest-645765861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d9bf345e-6a61-4852-ae2b-a8a2f4e050cd tempest-VolumesGetTest-645765861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d9bf345e-6a61-4852-ae2b-a8a2f4e050cd tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d9bf345e-6a61-4852-ae2b-a8a2f4e050cd tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:33 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:49:33 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:34 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d9bf345e-6a61-4852-ae2b-a8a2f4e050cd tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.619s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:34 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-d9bf345e-6a61-4852-ae2b-a8a2f4e050cd tempest-VolumesGetTest-645765861 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:49:34 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d9bf345e-6a61-4852-ae2b-a8a2f4e050cd tempest-VolumesGetTest-645765861 None] Deleted volume successfully. Jul 10 04:49:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d9bf345e-6a61-4852-ae2b-a8a2f4e050cd tempest-VolumesGetTest-645765861 None] Lock "cinder-379beac4-5e53-499c-8ba5-0337e88d7fef-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-72077c90-d68b-434f-805e-34eb37340031 tempest-VolumesGetTest-645765861 None] Acquiring lock "cinder-66b195cb-3f37-49d9-9b80-dbc69b14128b-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-72077c90-d68b-434f-805e-34eb37340031 tempest-VolumesGetTest-645765861 None] Lock "cinder-66b195cb-3f37-49d9-9b80-dbc69b14128b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-72077c90-d68b-434f-805e-34eb37340031 tempest-VolumesGetTest-645765861 None] Acquiring lock "cinder-quobyte-66b195cb-3f37-49d9-9b80-dbc69b14128b" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-72077c90-d68b-434f-805e-34eb37340031 tempest-VolumesGetTest-645765861 None] Lock "cinder-quobyte-66b195cb-3f37-49d9-9b80-dbc69b14128b" acquired by "delete_volume" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:34 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[7854276c-fbcc-4c2a-a6a5-32da9f035208]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-72077c90-d68b-434f-805e-34eb37340031 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:34 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b Jul 10 04:49:34 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:35 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-72077c90-d68b-434f-805e-34eb37340031 tempest-VolumesGetTest-645765861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b" returned: 0 in 0.727s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-72077c90-d68b-434f-805e-34eb37340031 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:35 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b Jul 10 04:49:35 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:35 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-72077c90-d68b-434f-805e-34eb37340031 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-66b195cb-3f37-49d9-9b80-dbc69b14128b" returned: 0 in 0.621s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-72077c90-d68b-434f-805e-34eb37340031 tempest-VolumesGetTest-645765861 None] Lock "cinder-quobyte-66b195cb-3f37-49d9-9b80-dbc69b14128b" released by "delete_volume" :: held 1.400s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:35 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-72077c90-d68b-434f-805e-34eb37340031 tempest-VolumesGetTest-645765861 None] Created reservations ['ab6e9acb-75ed-4056-b308-1973545a0bb9', 'fe6259a0-8032-409d-adea-70d6b91138fd', '00af3c7c-211d-4c15-9e2b-dcf1f8fc2a4f', 'e5c43cf2-f171-4685-9a77-6266b0c25f09'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:49:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-72077c90-d68b-434f-805e-34eb37340031 tempest-VolumesGetTest-645765861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-72077c90-d68b-434f-805e-34eb37340031 tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:36 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-72077c90-d68b-434f-805e-34eb37340031 tempest-VolumesGetTest-645765861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:36 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-72077c90-d68b-434f-805e-34eb37340031 tempest-VolumesGetTest-645765861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-72077c90-d68b-434f-805e-34eb37340031 tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-72077c90-d68b-434f-805e-34eb37340031 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:36 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:49:36 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:36 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-72077c90-d68b-434f-805e-34eb37340031 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.631s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:36 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-72077c90-d68b-434f-805e-34eb37340031 tempest-VolumesGetTest-645765861 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:49:36 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-72077c90-d68b-434f-805e-34eb37340031 tempest-VolumesGetTest-645765861 None] Deleted volume successfully. Jul 10 04:49:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-72077c90-d68b-434f-805e-34eb37340031 tempest-VolumesGetTest-645765861 None] Lock "cinder-66b195cb-3f37-49d9-9b80-dbc69b14128b-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:37 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:49:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Flow 'volume_create_manager' (bda8ffc9-4676-41be-97e5-a7119d2af9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f282f1c-c1df-4891-84ec-37bcf3a2e0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f282f1c-c1df-4891-84ec-37bcf3a2e0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1099693046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f63b399dd2f740aba9898dec4e68de1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:37Z,use_quota=True,user_id='947bf09ff660431f886c2937355c8b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (350276ee-2ae2-4658-a101-3021643bc0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (350276ee-2ae2-4658-a101-3021643bc0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (212f8a94-e8b6-46ed-a065-bc5598e41a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:37 devstack cinder-volume[87359]: DEBUG cinder.image.glance [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Creating Keystone auth plugin from conf {{(pid=87359) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 04:49:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (212f8a94-e8b6-46ed-a065-bc5598e41a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d', 'volume_name': 'volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d', 'volume_size': 1, 'image_id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fde3189e780b4bb09257315f8463a754', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'created_at': datetime.datetime(2026, 7, 10, 2, 27, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 27, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f148b33-7c87-45fa-9b71-3295f9e93abc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd67d81b-6f9f-424c-93f1-bb21c5f7993d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd67d81b-6f9f-424c-93f1-bb21c5f7993d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b530395b-d7ae-4d0b-8131-03f2d0322a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:37 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Volume 3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d', 'volume_size': 1, 'image_id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fde3189e780b4bb09257315f8463a754', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'created_at': datetime.datetime(2026, 7, 10, 2, 27, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 27, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f148b33-7c87-45fa-9b71-3295f9e93abc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 04:49:37 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Trying to clone 3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d from image 7f148b33-7c87-45fa-9b71-3295f9e93abc at location (None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}]). {{(pid=87359) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 04:49:38 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_nx3wgt2xdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Jul 10 04:49:38 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Image download 20.69 MB at 20.69 MB/s Jul 10 04:49:38 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b80fdc-d7e2-43ed-9e8e-4c8416803fdb]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_nx3wgt2xdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:38 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_nx3wgt2xdevstack@QuobyteHD Jul 10 04:49:38 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:38 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_nx3wgt2xdevstack@QuobyteHD" returned: 0 in 0.708s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:38 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Temporary image 7f148b33-7c87-45fa-9b71-3295f9e93abc is fetched for user 947bf09ff660431f886c2937355c8b2b. {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Jul 10 04:49:38 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23382ec-c3c4-4e45-807c-ea106c434ba4]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_nx3wgt2xdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:38 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_nx3wgt2xdevstack@QuobyteHD Jul 10 04:49:38 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:39 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_nx3wgt2xdevstack@QuobyteHD" returned: 0 in 0.752s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1099693046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f63b399dd2f740aba9898dec4e68de1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:37Z,use_quota=True,user_id='947bf09ff660431f886c2937355c8b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:49:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Creating volume 3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:49:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:49:39 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:49:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:39 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d 1073741824 Jul 10 04:49:39 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:40 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d 1073741824" returned: 0 in 0.779s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:40 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d Jul 10 04:49:40 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:41 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d" returned: 0 in 0.620s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:49:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:41 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Attempting download of 7f148b33-7c87-45fa-9b71-3295f9e93abc ((None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}])) to volume 3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d. {{(pid=87359) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 04:49:41 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d4d57e-9285-4f7a-ad10-46c9e4ee8221]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_4x_8u6rk {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:41 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_4x_8u6rk Jul 10 04:49:41 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:41 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_4x_8u6rk" returned: 0 in 0.696s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_4x_8u6rk {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:41 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_4x_8u6rk Jul 10 04:49:41 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:42 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_4x_8u6rk" returned: 1 in 0.692s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_4x_8u6rk' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:49:42 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed995ae-b45f-4927-ae09-88fb1828e473]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_nx3wgt2xdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:42 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_nx3wgt2xdevstack@QuobyteHD Jul 10 04:49:42 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:43 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_nx3wgt2xdevstack@QuobyteHD" returned: 0 in 0.682s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:43 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] 7f148b33-7c87-45fa-9b71-3295f9e93abc was qcow2, converting to raw {{(pid=87359) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Jul 10 04:49:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_nx3wgt2xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:43 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_nx3wgt2xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d Jul 10 04:49:43 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:44 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_nx3wgt2xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d" returned: 0 in 1.758s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:44 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_nx3wgt2xdevstack@QuobyteHD, size 112.00 MB, duration 1.76 sec, destination /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:49:44 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Converted 112.00 MB image at 63.65 MB/s Jul 10 04:49:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:44 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d 1G Jul 10 04:49:44 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:45 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d 1G" returned: 0 in 0.703s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:45 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbe7290-851b-4900-b342-006c12fbc145]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:45 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d Jul 10 04:49:45 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:46 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d" returned: 0 in 0.708s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:46 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d Jul 10 04:49:46 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:47 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d" returned: 1 in 0.716s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:49:47 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Downloaded image 7f148b33-7c87-45fa-9b71-3295f9e93abc ((None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}])) to volume 3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d successfully. {{(pid=87359) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 04:49:47 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Temporary image 7f148b33-7c87-45fa-9b71-3295f9e93abc for user 947bf09ff660431f886c2937355c8b2b is deleted. {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Jul 10 04:49:47 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Marking volume 3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d as bootable. {{(pid=87359) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 04:49:47 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Copying metadata from image 7f148b33-7c87-45fa-9b71-3295f9e93abc to 3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d. {{(pid=87359) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 04:49:47 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Creating volume glance metadata for volume 3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d backed by image 7f148b33-7c87-45fa-9b71-3295f9e93abc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87359) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 04:49:47 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b530395b-d7ae-4d0b-8131-03f2d0322a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d', 'volume_size': 1, 'image_id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fde3189e780b4bb09257315f8463a754', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'created_at': datetime.datetime(2026, 7, 10, 2, 27, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 27, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f148b33-7c87-45fa-9b71-3295f9e93abc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:47 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e2a42d-10a8-43e7-8616-a66b86ff26c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:47 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Volume volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d (3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d): created successfully Jul 10 04:49:47 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e2a42d-10a8-43e7-8616-a66b86ff26c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:47 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Flow 'volume_create_manager' (bda8ffc9-4676-41be-97e5-a7119d2af9c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:47 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-096ce34d-da0a-4a29-a72f-e6ff47345ad3 tempest-VolumesGetTest-645765861 None] Created volume successfully. Jul 10 04:49:48 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:49:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Flow 'volume_create_manager' (13b24c09-322e-4eff-8658-594e65de7696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60ee2bd-1666-4618-b636-eba9126c82a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60ee2bd-1666-4618-b636-eba9126c82a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-40675287',display_name='tempest-VolumesGetTest-Volume-1668761404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1532eaf1-4fde-482a-985a-c5a529d7498c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63b399dd2f740aba9898dec4e68de1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:48Z,use_quota=True,user_id='947bf09ff660431f886c2937355c8b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e250295-b335-4299-876b-8738678ea08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e250295-b335-4299-876b-8738678ea08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd5ec66-8379-4c92-ad4c-b24e65513ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd5ec66-8379-4c92-ad4c-b24e65513ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1532eaf1-4fde-482a-985a-c5a529d7498c', 'volume_name': 'volume-1532eaf1-4fde-482a-985a-c5a529d7498c', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc42833-68cf-4c04-b4d5-45f487a4b823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc42833-68cf-4c04-b4d5-45f487a4b823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e51855-8727-4a50-9d4d-54b169e49b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:48 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Volume 1532eaf1-4fde-482a-985a-c5a529d7498c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1532eaf1-4fde-482a-985a-c5a529d7498c', 'volume_size': 1} Jul 10 04:49:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-40675287',display_name='tempest-VolumesGetTest-Volume-1668761404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1532eaf1-4fde-482a-985a-c5a529d7498c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63b399dd2f740aba9898dec4e68de1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:48Z,use_quota=True,user_id='947bf09ff660431f886c2937355c8b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:49:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Creating volume 1532eaf1-4fde-482a-985a-c5a529d7498c {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:49:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:49:48 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:49:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1532eaf1-4fde-482a-985a-c5a529d7498c 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:48 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1532eaf1-4fde-482a-985a-c5a529d7498c 1073741824 Jul 10 04:49:48 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:49 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1532eaf1-4fde-482a-985a-c5a529d7498c 1073741824" returned: 0 in 0.758s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1532eaf1-4fde-482a-985a-c5a529d7498c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:49 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1532eaf1-4fde-482a-985a-c5a529d7498c Jul 10 04:49:49 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:49 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1532eaf1-4fde-482a-985a-c5a529d7498c" returned: 0 in 0.633s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:49:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e51855-8727-4a50-9d4d-54b169e49b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1532eaf1-4fde-482a-985a-c5a529d7498c', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b24fd7e-28b0-4467-a4fd-c6f5afdf7211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:49 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Volume volume-1532eaf1-4fde-482a-985a-c5a529d7498c (1532eaf1-4fde-482a-985a-c5a529d7498c): created successfully Jul 10 04:49:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b24fd7e-28b0-4467-a4fd-c6f5afdf7211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Flow 'volume_create_manager' (13b24c09-322e-4eff-8658-594e65de7696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:49 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-29c2a044-42d2-41e4-a9bc-b1d23c5a98c4 tempest-VolumesGetTest-645765861 None] Created volume successfully. Jul 10 04:49:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-21e8a478-ab60-4c57-bea3-42e2ef0f0af6 tempest-VolumesGetTest-645765861 None] Acquiring lock "cinder-1532eaf1-4fde-482a-985a-c5a529d7498c-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-21e8a478-ab60-4c57-bea3-42e2ef0f0af6 tempest-VolumesGetTest-645765861 None] Lock "cinder-1532eaf1-4fde-482a-985a-c5a529d7498c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-21e8a478-ab60-4c57-bea3-42e2ef0f0af6 tempest-VolumesGetTest-645765861 None] Acquiring lock "cinder-quobyte-1532eaf1-4fde-482a-985a-c5a529d7498c" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-21e8a478-ab60-4c57-bea3-42e2ef0f0af6 tempest-VolumesGetTest-645765861 None] Lock "cinder-quobyte-1532eaf1-4fde-482a-985a-c5a529d7498c" acquired by "delete_volume" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:50 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c00969-7334-4cdb-8abe-d7f1625a19c7]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-21e8a478-ab60-4c57-bea3-42e2ef0f0af6 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1532eaf1-4fde-482a-985a-c5a529d7498c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:50 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1532eaf1-4fde-482a-985a-c5a529d7498c Jul 10 04:49:50 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:51 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-21e8a478-ab60-4c57-bea3-42e2ef0f0af6 tempest-VolumesGetTest-645765861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1532eaf1-4fde-482a-985a-c5a529d7498c" returned: 0 in 0.737s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-21e8a478-ab60-4c57-bea3-42e2ef0f0af6 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1532eaf1-4fde-482a-985a-c5a529d7498c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:51 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1532eaf1-4fde-482a-985a-c5a529d7498c Jul 10 04:49:51 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:52 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-21e8a478-ab60-4c57-bea3-42e2ef0f0af6 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1532eaf1-4fde-482a-985a-c5a529d7498c" returned: 0 in 0.606s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-21e8a478-ab60-4c57-bea3-42e2ef0f0af6 tempest-VolumesGetTest-645765861 None] Lock "cinder-quobyte-1532eaf1-4fde-482a-985a-c5a529d7498c" released by "delete_volume" :: held 1.378s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:52 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-21e8a478-ab60-4c57-bea3-42e2ef0f0af6 tempest-VolumesGetTest-645765861 None] Created reservations ['bf8032d7-75f9-4a6b-8fdb-82c99c08dcb0', '0041121f-4139-45be-8cd6-e44ffb423ede', 'e3b1dc76-0122-43a0-b49f-fb7e8dfca291', '39c1eb74-4de1-40c1-bcb0-d0411dbdb598'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:49:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-21e8a478-ab60-4c57-bea3-42e2ef0f0af6 tempest-VolumesGetTest-645765861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-21e8a478-ab60-4c57-bea3-42e2ef0f0af6 tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:52 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-21e8a478-ab60-4c57-bea3-42e2ef0f0af6 tempest-VolumesGetTest-645765861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:52 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-21e8a478-ab60-4c57-bea3-42e2ef0f0af6 tempest-VolumesGetTest-645765861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-21e8a478-ab60-4c57-bea3-42e2ef0f0af6 tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-21e8a478-ab60-4c57-bea3-42e2ef0f0af6 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:52 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:49:52 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:52 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-21e8a478-ab60-4c57-bea3-42e2ef0f0af6 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.608s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:52 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-21e8a478-ab60-4c57-bea3-42e2ef0f0af6 tempest-VolumesGetTest-645765861 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:49:52 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-21e8a478-ab60-4c57-bea3-42e2ef0f0af6 tempest-VolumesGetTest-645765861 None] Deleted volume successfully. Jul 10 04:49:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-21e8a478-ab60-4c57-bea3-42e2ef0f0af6 tempest-VolumesGetTest-645765861 None] Lock "cinder-1532eaf1-4fde-482a-985a-c5a529d7498c-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] Acquiring lock "cinder-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] Lock "cinder-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] Acquiring lock "cinder-quobyte-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] Lock "cinder-quobyte-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:53 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bfcb6a-1644-48cf-87aa-26bf1962aaba]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:53 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d Jul 10 04:49:53 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:53 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d" returned: 0 in 0.750s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:53 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d Jul 10 04:49:53 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:54 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d" returned: 1 in 0.720s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:49:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:54 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d Jul 10 04:49:54 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:55 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d" returned: 0 in 0.623s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] Lock "cinder-quobyte-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d" released by "delete_volume" :: held 2.151s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:55 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=88,cinder:SELECT=63,cinder:DELETE=8,cinder:INSERT=26 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:49:55 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] Created reservations ['8e05cd7f-ef7e-43ae-a4fc-9960accd71e2', '780cc31f-5dba-4d10-98e6-39f0a40c0a33', '29314000-c9f5-4a00-be8a-3169f45c445a', '5ededd70-1909-4be7-96c3-6cdd73046485'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:49:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:55 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:49:55 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:55 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.644s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:55 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:49:55 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] Deleted volume successfully. Jul 10 04:49:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d1e37f1a-15d3-4826-8746-5bc019393aa4 tempest-VolumesGetTest-645765861 None] Lock "cinder-3dde8032-67f8-4ba2-8fb7-8d7aeb06fc0d-delete_volume" released by "delete_volume" :: held 2.986s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:06 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:50:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Flow 'volume_create_manager' (8c090fde-81c3-49f9-90c6-5c11eb7d0c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:50:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8274ded3-3814-4eb4-aa0c-3a2a00f810df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8274ded3-3814-4eb4-aa0c-3a2a00f810df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1352390566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365769f8-a9cd-443b-bde9-b9235fd5d551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af9d5be839424abca1f4bf7fae0b2767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:50:06Z,use_quota=True,user_id='2a799329e47e4f5ebf2f31f27dba2465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2fc622-f5bc-41cf-b5c6-91e0edd55cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2fc622-f5bc-41cf-b5c6-91e0edd55cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e162c9d8-4b02-4d5f-a58a-5e775d0df88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e162c9d8-4b02-4d5f-a58a-5e775d0df88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '365769f8-a9cd-443b-bde9-b9235fd5d551', 'volume_name': 'volume-365769f8-a9cd-443b-bde9-b9235fd5d551', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d41327-6721-460b-afd0-ae1d10f7be5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d41327-6721-460b-afd0-ae1d10f7be5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1590fa83-535b-4060-8f1c-c047b0a7fa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:06 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Volume 365769f8-a9cd-443b-bde9-b9235fd5d551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-365769f8-a9cd-443b-bde9-b9235fd5d551', 'volume_size': 1} Jul 10 04:50:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1352390566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365769f8-a9cd-443b-bde9-b9235fd5d551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af9d5be839424abca1f4bf7fae0b2767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:50:06Z,use_quota=True,user_id='2a799329e47e4f5ebf2f31f27dba2465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:50:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Creating volume 365769f8-a9cd-443b-bde9-b9235fd5d551 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:50:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:50:06 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:50:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:06 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551 1073741824 Jul 10 04:50:06 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:07 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551 1073741824" returned: 0 in 0.790s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:07 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551 Jul 10 04:50:07 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:07 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551" returned: 0 in 0.625s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:50:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1590fa83-535b-4060-8f1c-c047b0a7fa90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-365769f8-a9cd-443b-bde9-b9235fd5d551', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca405d9-0142-4cd0-b9e3-d428b01f4416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:07 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Volume volume-365769f8-a9cd-443b-bde9-b9235fd5d551 (365769f8-a9cd-443b-bde9-b9235fd5d551): created successfully Jul 10 04:50:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca405d9-0142-4cd0-b9e3-d428b01f4416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Flow 'volume_create_manager' (8c090fde-81c3-49f9-90c6-5c11eb7d0c6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:50:07 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ad140aac-1932-4f68-9d58-fea0ee6992c6 tempest-VolumesSnapshotTestJSON-1235651696 None] Created volume successfully. Jul 10 04:50:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4b49cc4e-b9a1-4209-8ee0-ec831d915aef tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4b49cc4e-b9a1-4209-8ee0-ec831d915aef tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-4b49cc4e-b9a1-4209-8ee0-ec831d915aef tempest-VolumesSnapshotTestJSON-1235651696 None] Creating offline snapshot c1d78354-afac-4518-b17f-3179d4ff179e of volume 365769f8-a9cd-443b-bde9-b9235fd5d551 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:50:08 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1f27c5-4d6d-46ee-8639-108f0cd198be]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4b49cc4e-b9a1-4209-8ee0-ec831d915aef tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:08 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551 Jul 10 04:50:08 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:09 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4b49cc4e-b9a1-4209-8ee0-ec831d915aef tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551" returned: 0 in 0.751s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4b49cc4e-b9a1-4209-8ee0-ec831d915aef tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.c1d78354-afac-4518-b17f-3179d4ff179e 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:09 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.c1d78354-afac-4518-b17f-3179d4ff179e 1G Jul 10 04:50:09 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:10 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4b49cc4e-b9a1-4209-8ee0-ec831d915aef tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.c1d78354-afac-4518-b17f-3179d4ff179e 1G" returned: 0 in 0.783s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4b49cc4e-b9a1-4209-8ee0-ec831d915aef tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-365769f8-a9cd-443b-bde9-b9235fd5d551 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.c1d78354-afac-4518-b17f-3179d4ff179e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:10 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-365769f8-a9cd-443b-bde9-b9235fd5d551 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.c1d78354-afac-4518-b17f-3179d4ff179e Jul 10 04:50:10 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:11 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4b49cc4e-b9a1-4209-8ee0-ec831d915aef tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-365769f8-a9cd-443b-bde9-b9235fd5d551 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.c1d78354-afac-4518-b17f-3179d4ff179e" returned: 0 in 0.696s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:11 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-4b49cc4e-b9a1-4209-8ee0-ec831d915aef tempest-VolumesSnapshotTestJSON-1235651696 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.c1d78354-afac-4518-b17f-3179d4ff179e is being set with open permissions: ugo+rw Jul 10 04:50:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4b49cc4e-b9a1-4209-8ee0-ec831d915aef tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.c1d78354-afac-4518-b17f-3179d4ff179e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:11 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.c1d78354-afac-4518-b17f-3179d4ff179e Jul 10 04:50:11 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:11 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4b49cc4e-b9a1-4209-8ee0-ec831d915aef tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.c1d78354-afac-4518-b17f-3179d4ff179e" returned: 0 in 0.639s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4b49cc4e-b9a1-4209-8ee0-ec831d915aef tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:11 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.info Jul 10 04:50:11 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:12 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4b49cc4e-b9a1-4209-8ee0-ec831d915aef tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.info" returned: 0 in 0.626s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:12 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-4b49cc4e-b9a1-4209-8ee0-ec831d915aef tempest-VolumesSnapshotTestJSON-1235651696 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.info is being set with open permissions: ugo+rw Jul 10 04:50:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4b49cc4e-b9a1-4209-8ee0-ec831d915aef tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:12 devstack sudo[101716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.info Jul 10 04:50:12 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:12 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4b49cc4e-b9a1-4209-8ee0-ec831d915aef tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.info" returned: 0 in 0.615s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4b49cc4e-b9a1-4209-8ee0-ec831d915aef tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.203s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:13 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-4b49cc4e-b9a1-4209-8ee0-ec831d915aef tempest-VolumesSnapshotTestJSON-1235651696 None] Create snapshot completed successfully Jul 10 04:50:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-70c0a43d-f7de-4633-be1f-2c72293d2a03 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-c1d78354-afac-4518-b17f-3179d4ff179e-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-70c0a43d-f7de-4633-be1f-2c72293d2a03 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-c1d78354-afac-4518-b17f-3179d4ff179e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-70c0a43d-f7de-4633-be1f-2c72293d2a03 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-quobyte-365769f8-a9cd-443b-bde9-b9235fd5d551" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-70c0a43d-f7de-4633-be1f-2c72293d2a03 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-365769f8-a9cd-443b-bde9-b9235fd5d551" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-70c0a43d-f7de-4633-be1f-2c72293d2a03 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-quobyte-c1d78354-afac-4518-b17f-3179d4ff179e" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-70c0a43d-f7de-4633-be1f-2c72293d2a03 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-c1d78354-afac-4518-b17f-3179d4ff179e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-70c0a43d-f7de-4633-be1f-2c72293d2a03 tempest-VolumesSnapshotTestJSON-1235651696 None] Deleting offline snapshot c1d78354-afac-4518-b17f-3179d4ff179e of volume 365769f8-a9cd-443b-bde9-b9235fd5d551 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:50:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-70c0a43d-f7de-4633-be1f-2c72293d2a03 tempest-VolumesSnapshotTestJSON-1235651696 None] snapshot_file for this snap is: volume-365769f8-a9cd-443b-bde9-b9235fd5d551.c1d78354-afac-4518-b17f-3179d4ff179e {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:50:14 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[30031b8f-bbff-4050-be7f-1d3574abd7b9]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70c0a43d-f7de-4633-be1f-2c72293d2a03 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.c1d78354-afac-4518-b17f-3179d4ff179e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:14 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.c1d78354-afac-4518-b17f-3179d4ff179e Jul 10 04:50:14 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:14 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70c0a43d-f7de-4633-be1f-2c72293d2a03 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.c1d78354-afac-4518-b17f-3179d4ff179e" returned: 0 in 0.728s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-70c0a43d-f7de-4633-be1f-2c72293d2a03 tempest-VolumesSnapshotTestJSON-1235651696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-365769f8-a9cd-443b-bde9-b9235fd5d551(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:50:14 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe61fb80-b09a-48e9-9f16-92fb872aa298]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70c0a43d-f7de-4633-be1f-2c72293d2a03 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:14 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551 Jul 10 04:50:14 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:15 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70c0a43d-f7de-4633-be1f-2c72293d2a03 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551" returned: 0 in 0.725s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70c0a43d-f7de-4633-be1f-2c72293d2a03 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.c1d78354-afac-4518-b17f-3179d4ff179e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:15 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.c1d78354-afac-4518-b17f-3179d4ff179e Jul 10 04:50:15 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:50:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:15 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:50:15 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:16 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70c0a43d-f7de-4633-be1f-2c72293d2a03 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.c1d78354-afac-4518-b17f-3179d4ff179e" returned: 0 in 0.711s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70c0a43d-f7de-4633-be1f-2c72293d2a03 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.c1d78354-afac-4518-b17f-3179d4ff179e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:16 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.c1d78354-afac-4518-b17f-3179d4ff179e Jul 10 04:50:16 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:16 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.680s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:50:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:50:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:50:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:50:16 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-70c0a43d-f7de-4633-be1f-2c72293d2a03 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551.c1d78354-afac-4518-b17f-3179d4ff179e" returned: 0 in 0.615s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:16 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-70c0a43d-f7de-4633-be1f-2c72293d2a03 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-c1d78354-afac-4518-b17f-3179d4ff179e" released by "_delete_snapshot" :: held 2.874s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:16 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-70c0a43d-f7de-4633-be1f-2c72293d2a03 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-365769f8-a9cd-443b-bde9-b9235fd5d551" released by "delete_snapshot" :: held 2.898s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:16 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-70c0a43d-f7de-4633-be1f-2c72293d2a03 tempest-VolumesSnapshotTestJSON-1235651696 None] Created reservations ['7e04f83a-4a33-465d-8e59-7cf56d4a49ef', '612cd9fd-aa82-40ac-892b-82718d3eb762', '0e9904ab-fcb7-452b-b576-94c673c07224', '8fe407fa-b61b-44ed-a5bc-5de3c8250030'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:50:17 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-70c0a43d-f7de-4633-be1f-2c72293d2a03 tempest-VolumesSnapshotTestJSON-1235651696 None] Delete snapshot completed successfully. Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-70c0a43d-f7de-4633-be1f-2c72293d2a03 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-c1d78354-afac-4518-b17f-3179d4ff179e-delete_snapshot" released by "delete_snapshot" :: held 3.059s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Flow 'volume_create_manager' (e49926dc-52fa-470a-96be-f71d08ce6074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c29ef02-98d3-46a2-bad1-f1cc997a6d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c29ef02-98d3-46a2-bad1-f1cc997a6d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1919739563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed43dfb6-47a5-44b8-9510-bd67f59fb75a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af9d5be839424abca1f4bf7fae0b2767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:50:18Z,use_quota=True,user_id='2a799329e47e4f5ebf2f31f27dba2465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33041835-5e6f-41d3-a88e-592ca55ba909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33041835-5e6f-41d3-a88e-592ca55ba909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400b28d2-1762-45cc-bccb-919e4789042f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400b28d2-1762-45cc-bccb-919e4789042f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed43dfb6-47a5-44b8-9510-bd67f59fb75a', 'volume_name': 'volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62714f01-c89f-4af6-b74c-9ea0d269586f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62714f01-c89f-4af6-b74c-9ea0d269586f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98af8a7-c693-4cdb-8da2-d08558447f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:17 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Volume ed43dfb6-47a5-44b8-9510-bd67f59fb75a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a', 'volume_size': 1} Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1919739563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed43dfb6-47a5-44b8-9510-bd67f59fb75a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af9d5be839424abca1f4bf7fae0b2767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:50:18Z,use_quota=True,user_id='2a799329e47e4f5ebf2f31f27dba2465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Creating volume ed43dfb6-47a5-44b8-9510-bd67f59fb75a {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:50:17 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:50:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:17 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a 1073741824 Jul 10 04:50:17 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:18 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a 1073741824" returned: 0 in 0.806s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:18 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a Jul 10 04:50:18 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:19 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a" returned: 0 in 0.635s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:50:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98af8a7-c693-4cdb-8da2-d08558447f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f6d526-9503-4cbb-af22-49a4ceb7a404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:19 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Volume volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a (ed43dfb6-47a5-44b8-9510-bd67f59fb75a): created successfully Jul 10 04:50:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f6d526-9503-4cbb-af22-49a4ceb7a404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Flow 'volume_create_manager' (e49926dc-52fa-470a-96be-f71d08ce6074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:50:19 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-930d45d2-e5f9-463d-ac46-66d28d23fe11 tempest-VolumesSnapshotTestJSON-1235651696 None] Created volume successfully. Jul 10 04:50:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-57cfd962-88e8-47ff-8c05-1921e2e67490 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-57cfd962-88e8-47ff-8c05-1921e2e67490 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-57cfd962-88e8-47ff-8c05-1921e2e67490 tempest-VolumesSnapshotTestJSON-1235651696 None] Creating offline snapshot 3b0d5ac1-e41e-4639-9904-13bd4791e490 of volume ed43dfb6-47a5-44b8-9510-bd67f59fb75a {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:50:19 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf58b62-a90a-43d3-a466-e5ad5bc5d327]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-57cfd962-88e8-47ff-8c05-1921e2e67490 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:19 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a Jul 10 04:50:19 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:20 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-57cfd962-88e8-47ff-8c05-1921e2e67490 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a" returned: 0 in 0.772s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-57cfd962-88e8-47ff-8c05-1921e2e67490 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:20 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490 1G Jul 10 04:50:20 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:21 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-57cfd962-88e8-47ff-8c05-1921e2e67490 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490 1G" returned: 0 in 0.766s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-57cfd962-88e8-47ff-8c05-1921e2e67490 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:21 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490 Jul 10 04:50:21 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:22 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-57cfd962-88e8-47ff-8c05-1921e2e67490 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490" returned: 0 in 0.705s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:22 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-57cfd962-88e8-47ff-8c05-1921e2e67490 tempest-VolumesSnapshotTestJSON-1235651696 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490 is being set with open permissions: ugo+rw Jul 10 04:50:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-57cfd962-88e8-47ff-8c05-1921e2e67490 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:22 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490 Jul 10 04:50:22 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:22 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-57cfd962-88e8-47ff-8c05-1921e2e67490 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490" returned: 0 in 0.633s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-57cfd962-88e8-47ff-8c05-1921e2e67490 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:22 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.info Jul 10 04:50:22 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:23 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-57cfd962-88e8-47ff-8c05-1921e2e67490 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.info" returned: 0 in 0.677s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:23 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-57cfd962-88e8-47ff-8c05-1921e2e67490 tempest-VolumesSnapshotTestJSON-1235651696 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.info is being set with open permissions: ugo+rw Jul 10 04:50:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-57cfd962-88e8-47ff-8c05-1921e2e67490 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:23 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.info Jul 10 04:50:23 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:24 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-57cfd962-88e8-47ff-8c05-1921e2e67490 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.info" returned: 0 in 0.622s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-57cfd962-88e8-47ff-8c05-1921e2e67490 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.255s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:24 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-57cfd962-88e8-47ff-8c05-1921e2e67490 tempest-VolumesSnapshotTestJSON-1235651696 None] Create snapshot completed successfully Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=68,cinder:SELECT=66,cinder:DELETE=9,cinder:INSERT=22 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Flow 'volume_create_manager' (20ba4773-73f4-4915-851e-b69c18589c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93039228-85ed-4be8-9b40-8e98a79e1c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93039228-85ed-4be8-9b40-8e98a79e1c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1821659075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1716ee52-5410-4b67-855b-057acc46daf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af9d5be839424abca1f4bf7fae0b2767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:50:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3b0d5ac1-e41e-4639-9904-13bd4791e490,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:50:25Z,use_quota=True,user_id='2a799329e47e4f5ebf2f31f27dba2465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc04e31-c1ab-4f66-906a-359dd4d097e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc04e31-c1ab-4f66-906a-359dd4d097e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d608e6d-6391-4c6b-9439-eff8d1a4937d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d608e6d-6391-4c6b-9439-eff8d1a4937d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1716ee52-5410-4b67-855b-057acc46daf0', 'volume_name': 'volume-1716ee52-5410-4b67-855b-057acc46daf0', 'volume_size': 2, 'snapshot_id': '3b0d5ac1-e41e-4639-9904-13bd4791e490'}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6462748a-9e58-477f-9dfd-05a936929231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6462748a-9e58-477f-9dfd-05a936929231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be9f753-4ecd-4b0e-b163-c1fb151db33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:25 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Volume 1716ee52-5410-4b67-855b-057acc46daf0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1716ee52-5410-4b67-855b-057acc46daf0', 'volume_size': 2, 'snapshot_id': '3b0d5ac1-e41e-4639-9904-13bd4791e490'} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-quobyte-3b0d5ac1-e41e-4639-9904-13bd4791e490-1716ee52-5410-4b67-855b-057acc46daf0" by "_create_volume_from_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-3b0d5ac1-e41e-4639-9904-13bd4791e490-1716ee52-5410-4b67-855b-057acc46daf0" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Creating volume 1716ee52-5410-4b67-855b-057acc46daf0 from snapshot 3b0d5ac1-e41e-4639-9904-13bd4791e490 {{(pid=87359) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-quobyte-1716ee52-5410-4b67-855b-057acc46daf0" by "_copy_volume_from_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-1716ee52-5410-4b67-855b-057acc46daf0" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] snapshot: 3b0d5ac1-e41e-4639-9904-13bd4791e490, volume: 1716ee52-5410-4b67-855b-057acc46daf0, {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[457d047e-7326-40f8-b2e9-55f42f1f1c30]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:25 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490 Jul 10 04:50:25 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:26 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490" returned: 0 in 0.786s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:50:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 04:50:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Creating direct copy from snapshot {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 04:50:26 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ecf2af-3d54-4cd7-8adb-f4bf87363e12]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:26 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a Jul 10 04:50:26 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:27 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a" returned: 0 in 0.731s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:27 devstack cinder-volume[87359]: DEBUG cinder.utils [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Path /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1716ee52-5410-4b67-855b-057acc46daf0 not found in is_blk_device check {{(pid=87359) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 04:50:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1716ee52-5410-4b67-855b-057acc46daf0 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:27 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1716ee52-5410-4b67-855b-057acc46daf0 Jul 10 04:50:27 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:31 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1716ee52-5410-4b67-855b-057acc46daf0" returned: 0 in 4.399s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:31 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a81ab22-af7d-40b8-b764-093ad6eac6ec]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:31 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a Jul 10 04:50:31 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:32 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a" returned: 0 in 0.909s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:32 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a, size 1024.00 MB, duration 4.40 sec, destination /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1716ee52-5410-4b67-855b-057acc46daf0 {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:50:32 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Converted 1024.00 MB image at 232.70 MB/s Jul 10 04:50:32 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1716ee52-5410-4b67-855b-057acc46daf0 is being set with open permissions: ugo+rw Jul 10 04:50:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1716ee52-5410-4b67-855b-057acc46daf0 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:32 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1716ee52-5410-4b67-855b-057acc46daf0 Jul 10 04:50:32 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:33 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1716ee52-5410-4b67-855b-057acc46daf0" returned: 0 in 0.630s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-1716ee52-5410-4b67-855b-057acc46daf0" released by "_copy_volume_from_snapshot" :: held 7.540s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-3b0d5ac1-e41e-4639-9904-13bd4791e490-1716ee52-5410-4b67-855b-057acc46daf0" released by "_create_volume_from_snapshot" :: held 7.568s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.584s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be9f753-4ecd-4b0e-b163-c1fb151db33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1716ee52-5410-4b67-855b-057acc46daf0', 'volume_size': 2, 'snapshot_id': '3b0d5ac1-e41e-4639-9904-13bd4791e490'}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06816a98-109a-428e-80ee-15f2c9e9d796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:33 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Volume volume-1716ee52-5410-4b67-855b-057acc46daf0 (1716ee52-5410-4b67-855b-057acc46daf0): created successfully Jul 10 04:50:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06816a98-109a-428e-80ee-15f2c9e9d796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Flow 'volume_create_manager' (20ba4773-73f4-4915-851e-b69c18589c15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:50:33 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-936abd06-ee01-4c68-bdd0-941216891a60 tempest-VolumesSnapshotTestJSON-1235651696 None] Created volume successfully. Jul 10 04:50:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ea718857-3268-4fe7-b8a9-e7614fb1df8b tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-1716ee52-5410-4b67-855b-057acc46daf0-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ea718857-3268-4fe7-b8a9-e7614fb1df8b tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-1716ee52-5410-4b67-855b-057acc46daf0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ea718857-3268-4fe7-b8a9-e7614fb1df8b tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-quobyte-1716ee52-5410-4b67-855b-057acc46daf0" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ea718857-3268-4fe7-b8a9-e7614fb1df8b tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-1716ee52-5410-4b67-855b-057acc46daf0" acquired by "delete_volume" :: waited 0.013s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:34 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10d14ff-5e28-4264-a64f-7a66dd1edbb9]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ea718857-3268-4fe7-b8a9-e7614fb1df8b tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1716ee52-5410-4b67-855b-057acc46daf0 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:34 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1716ee52-5410-4b67-855b-057acc46daf0 Jul 10 04:50:34 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:34 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ea718857-3268-4fe7-b8a9-e7614fb1df8b tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1716ee52-5410-4b67-855b-057acc46daf0" returned: 0 in 0.718s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ea718857-3268-4fe7-b8a9-e7614fb1df8b tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1716ee52-5410-4b67-855b-057acc46daf0 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:35 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1716ee52-5410-4b67-855b-057acc46daf0 Jul 10 04:50:35 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:35 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ea718857-3268-4fe7-b8a9-e7614fb1df8b tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-1716ee52-5410-4b67-855b-057acc46daf0" returned: 0 in 0.616s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ea718857-3268-4fe7-b8a9-e7614fb1df8b tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-1716ee52-5410-4b67-855b-057acc46daf0" released by "delete_volume" :: held 1.368s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:35 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-ea718857-3268-4fe7-b8a9-e7614fb1df8b tempest-VolumesSnapshotTestJSON-1235651696 None] Created reservations ['7a460f6d-d727-4d2a-b8e6-f8d5202d08da', 'b9e54d71-c97b-4cc0-815c-43bb18c12f07', '3106d60d-e040-4cee-a418-af7f14773227', 'cedf6997-d2a8-420a-8dcb-3cd8e8baad50'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:50:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ea718857-3268-4fe7-b8a9-e7614fb1df8b tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ea718857-3268-4fe7-b8a9-e7614fb1df8b tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ea718857-3268-4fe7-b8a9-e7614fb1df8b tempest-VolumesSnapshotTestJSON-1235651696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ea718857-3268-4fe7-b8a9-e7614fb1df8b tempest-VolumesSnapshotTestJSON-1235651696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ea718857-3268-4fe7-b8a9-e7614fb1df8b tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ea718857-3268-4fe7-b8a9-e7614fb1df8b tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:35 devstack sudo[101815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:50:35 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:36 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ea718857-3268-4fe7-b8a9-e7614fb1df8b tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.623s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:36 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-ea718857-3268-4fe7-b8a9-e7614fb1df8b tempest-VolumesSnapshotTestJSON-1235651696 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:50:36 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ea718857-3268-4fe7-b8a9-e7614fb1df8b tempest-VolumesSnapshotTestJSON-1235651696 None] Deleted volume successfully. Jul 10 04:50:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ea718857-3268-4fe7-b8a9-e7614fb1df8b tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-1716ee52-5410-4b67-855b-057acc46daf0-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6093cd1c-a5b4-4e0f-853a-a1c02b39fc6b tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-3b0d5ac1-e41e-4639-9904-13bd4791e490-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6093cd1c-a5b4-4e0f-853a-a1c02b39fc6b tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-3b0d5ac1-e41e-4639-9904-13bd4791e490-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6093cd1c-a5b4-4e0f-853a-a1c02b39fc6b tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-quobyte-ed43dfb6-47a5-44b8-9510-bd67f59fb75a" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6093cd1c-a5b4-4e0f-853a-a1c02b39fc6b tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-ed43dfb6-47a5-44b8-9510-bd67f59fb75a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6093cd1c-a5b4-4e0f-853a-a1c02b39fc6b tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-quobyte-3b0d5ac1-e41e-4639-9904-13bd4791e490" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6093cd1c-a5b4-4e0f-853a-a1c02b39fc6b tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-3b0d5ac1-e41e-4639-9904-13bd4791e490" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:36 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-6093cd1c-a5b4-4e0f-853a-a1c02b39fc6b tempest-VolumesSnapshotTestJSON-1235651696 None] Deleting offline snapshot 3b0d5ac1-e41e-4639-9904-13bd4791e490 of volume ed43dfb6-47a5-44b8-9510-bd67f59fb75a {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:50:36 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-6093cd1c-a5b4-4e0f-853a-a1c02b39fc6b tempest-VolumesSnapshotTestJSON-1235651696 None] snapshot_file for this snap is: volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:50:36 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4591301-374f-4f2f-9757-bd5e0286f522]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6093cd1c-a5b4-4e0f-853a-a1c02b39fc6b tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:36 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490 Jul 10 04:50:36 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:37 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6093cd1c-a5b4-4e0f-853a-a1c02b39fc6b tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490" returned: 0 in 0.743s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-6093cd1c-a5b4-4e0f-853a-a1c02b39fc6b tempest-VolumesSnapshotTestJSON-1235651696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:50:37 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1eee90-601e-43be-893d-ad93bb1047ee]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6093cd1c-a5b4-4e0f-853a-a1c02b39fc6b tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:37 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a Jul 10 04:50:37 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:37 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6093cd1c-a5b4-4e0f-853a-a1c02b39fc6b tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a" returned: 0 in 0.721s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6093cd1c-a5b4-4e0f-853a-a1c02b39fc6b tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:38 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490 Jul 10 04:50:38 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:38 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6093cd1c-a5b4-4e0f-853a-a1c02b39fc6b tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490" returned: 0 in 0.708s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6093cd1c-a5b4-4e0f-853a-a1c02b39fc6b tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:38 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490 Jul 10 04:50:38 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:39 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6093cd1c-a5b4-4e0f-853a-a1c02b39fc6b tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a.3b0d5ac1-e41e-4639-9904-13bd4791e490" returned: 0 in 0.608s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6093cd1c-a5b4-4e0f-853a-a1c02b39fc6b tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-3b0d5ac1-e41e-4639-9904-13bd4791e490" released by "_delete_snapshot" :: held 2.866s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6093cd1c-a5b4-4e0f-853a-a1c02b39fc6b tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-ed43dfb6-47a5-44b8-9510-bd67f59fb75a" released by "delete_snapshot" :: held 2.886s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:39 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-6093cd1c-a5b4-4e0f-853a-a1c02b39fc6b tempest-VolumesSnapshotTestJSON-1235651696 None] Created reservations ['75e93033-2eba-42c2-90f0-3b6f2992655c', '136c401b-3bb8-4c88-9e17-be45ac0d01af', '7c99ea4c-d13d-4b1f-9846-ed9b7c83a7a7', '49613176-b68e-439a-9e55-2fba4d27cd04'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:50:39 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-6093cd1c-a5b4-4e0f-853a-a1c02b39fc6b tempest-VolumesSnapshotTestJSON-1235651696 None] Delete snapshot completed successfully. Jul 10 04:50:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6093cd1c-a5b4-4e0f-853a-a1c02b39fc6b tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-3b0d5ac1-e41e-4639-9904-13bd4791e490-delete_snapshot" released by "delete_snapshot" :: held 3.003s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c73f0414-b7d6-41c8-abb4-0591980fe30c tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-ed43dfb6-47a5-44b8-9510-bd67f59fb75a-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c73f0414-b7d6-41c8-abb4-0591980fe30c tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-ed43dfb6-47a5-44b8-9510-bd67f59fb75a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c73f0414-b7d6-41c8-abb4-0591980fe30c tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-quobyte-ed43dfb6-47a5-44b8-9510-bd67f59fb75a" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c73f0414-b7d6-41c8-abb4-0591980fe30c tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-ed43dfb6-47a5-44b8-9510-bd67f59fb75a" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:39 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73848a4-2b18-43f0-bfc4-77baf5c4bdee]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c73f0414-b7d6-41c8-abb4-0591980fe30c tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:39 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a Jul 10 04:50:39 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:40 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c73f0414-b7d6-41c8-abb4-0591980fe30c tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a" returned: 0 in 0.715s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c73f0414-b7d6-41c8-abb4-0591980fe30c tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:40 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a Jul 10 04:50:40 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:41 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c73f0414-b7d6-41c8-abb4-0591980fe30c tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ed43dfb6-47a5-44b8-9510-bd67f59fb75a" returned: 0 in 0.618s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c73f0414-b7d6-41c8-abb4-0591980fe30c tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-ed43dfb6-47a5-44b8-9510-bd67f59fb75a" released by "delete_volume" :: held 1.386s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:41 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-c73f0414-b7d6-41c8-abb4-0591980fe30c tempest-VolumesSnapshotTestJSON-1235651696 None] Created reservations ['ae088c40-66f8-462c-a833-1bf9f03a1103', '026f9dbb-c68b-4f48-a79c-93427047ed4c', 'b0c8c87f-a97e-46d7-81cd-5db935f2afed', '1f8d7ec2-fd5e-4f1f-90cf-b1d5b0ead965'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:50:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c73f0414-b7d6-41c8-abb4-0591980fe30c tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c73f0414-b7d6-41c8-abb4-0591980fe30c tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c73f0414-b7d6-41c8-abb4-0591980fe30c tempest-VolumesSnapshotTestJSON-1235651696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c73f0414-b7d6-41c8-abb4-0591980fe30c tempest-VolumesSnapshotTestJSON-1235651696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c73f0414-b7d6-41c8-abb4-0591980fe30c tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c73f0414-b7d6-41c8-abb4-0591980fe30c tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:41 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:50:41 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:41 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c73f0414-b7d6-41c8-abb4-0591980fe30c tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.627s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:41 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-c73f0414-b7d6-41c8-abb4-0591980fe30c tempest-VolumesSnapshotTestJSON-1235651696 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:50:41 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c73f0414-b7d6-41c8-abb4-0591980fe30c tempest-VolumesSnapshotTestJSON-1235651696 None] Deleted volume successfully. Jul 10 04:50:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c73f0414-b7d6-41c8-abb4-0591980fe30c tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-ed43dfb6-47a5-44b8-9510-bd67f59fb75a-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:42 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:50:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Flow 'volume_create_manager' (c96ce62c-7787-4987-9bd1-6303fec7ed46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:50:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00741710-74d2-4f53-beb2-ff8e74d9ec4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00741710-74d2-4f53-beb2-ff8e74d9ec4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1889346523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0d7822-98a4-45b9-b474-0922fb6c4621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af9d5be839424abca1f4bf7fae0b2767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:50:42Z,use_quota=True,user_id='2a799329e47e4f5ebf2f31f27dba2465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c649c8b-f061-4067-9148-dcc342665433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c649c8b-f061-4067-9148-dcc342665433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd81619-87d6-4d89-92c5-24c40a92b29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd81619-87d6-4d89-92c5-24c40a92b29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be0d7822-98a4-45b9-b474-0922fb6c4621', 'volume_name': 'volume-be0d7822-98a4-45b9-b474-0922fb6c4621', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45df7790-ec8d-4143-bb0f-fa36856aed9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45df7790-ec8d-4143-bb0f-fa36856aed9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa5af3a-f259-45b2-ab28-16e1693fcc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:42 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Volume be0d7822-98a4-45b9-b474-0922fb6c4621: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be0d7822-98a4-45b9-b474-0922fb6c4621', 'volume_size': 1} Jul 10 04:50:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1889346523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0d7822-98a4-45b9-b474-0922fb6c4621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af9d5be839424abca1f4bf7fae0b2767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:50:42Z,use_quota=True,user_id='2a799329e47e4f5ebf2f31f27dba2465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:50:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Creating volume be0d7822-98a4-45b9-b474-0922fb6c4621 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:50:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:50:42 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:50:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:42 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621 1073741824 Jul 10 04:50:42 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:43 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621 1073741824" returned: 0 in 0.764s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:43 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621 Jul 10 04:50:43 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:43 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621" returned: 0 in 0.617s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:43 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:50:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa5af3a-f259-45b2-ab28-16e1693fcc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be0d7822-98a4-45b9-b474-0922fb6c4621', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d239ca-04e7-47b1-914f-5a85f6c8e696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:43 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Volume volume-be0d7822-98a4-45b9-b474-0922fb6c4621 (be0d7822-98a4-45b9-b474-0922fb6c4621): created successfully Jul 10 04:50:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d239ca-04e7-47b1-914f-5a85f6c8e696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Flow 'volume_create_manager' (c96ce62c-7787-4987-9bd1-6303fec7ed46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:50:43 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-f08932bb-32f2-4e88-88c0-f70bfeac79c5 tempest-VolumesSnapshotTestJSON-1235651696 None] Created volume successfully. Jul 10 04:50:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c7fba6c0-2937-41e4-9cc4-eaae8dbd13ff tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c7fba6c0-2937-41e4-9cc4-eaae8dbd13ff tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-c7fba6c0-2937-41e4-9cc4-eaae8dbd13ff tempest-VolumesSnapshotTestJSON-1235651696 None] Creating offline snapshot 2eb1d396-9923-421e-9474-8585c3e59b8f of volume be0d7822-98a4-45b9-b474-0922fb6c4621 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:50:44 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[494d1c4f-fc9d-410a-8594-60c935096da8]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c7fba6c0-2937-41e4-9cc4-eaae8dbd13ff tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:44 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621 Jul 10 04:50:44 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:45 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c7fba6c0-2937-41e4-9cc4-eaae8dbd13ff tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621" returned: 0 in 0.718s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c7fba6c0-2937-41e4-9cc4-eaae8dbd13ff tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:45 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f 1G Jul 10 04:50:45 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:46 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c7fba6c0-2937-41e4-9cc4-eaae8dbd13ff tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f 1G" returned: 0 in 0.755s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c7fba6c0-2937-41e4-9cc4-eaae8dbd13ff tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0d7822-98a4-45b9-b474-0922fb6c4621 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:46 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0d7822-98a4-45b9-b474-0922fb6c4621 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f Jul 10 04:50:46 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:46 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c7fba6c0-2937-41e4-9cc4-eaae8dbd13ff tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0d7822-98a4-45b9-b474-0922fb6c4621 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f" returned: 0 in 0.661s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:46 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-c7fba6c0-2937-41e4-9cc4-eaae8dbd13ff tempest-VolumesSnapshotTestJSON-1235651696 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f is being set with open permissions: ugo+rw Jul 10 04:50:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c7fba6c0-2937-41e4-9cc4-eaae8dbd13ff tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:46 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f Jul 10 04:50:46 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:47 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c7fba6c0-2937-41e4-9cc4-eaae8dbd13ff tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f" returned: 0 in 0.615s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c7fba6c0-2937-41e4-9cc4-eaae8dbd13ff tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:47 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.info Jul 10 04:50:47 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:48 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c7fba6c0-2937-41e4-9cc4-eaae8dbd13ff tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.info" returned: 0 in 0.637s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:48 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-c7fba6c0-2937-41e4-9cc4-eaae8dbd13ff tempest-VolumesSnapshotTestJSON-1235651696 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.info is being set with open permissions: ugo+rw Jul 10 04:50:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c7fba6c0-2937-41e4-9cc4-eaae8dbd13ff tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:48 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.info Jul 10 04:50:48 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:48 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c7fba6c0-2937-41e4-9cc4-eaae8dbd13ff tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.info" returned: 0 in 0.622s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c7fba6c0-2937-41e4-9cc4-eaae8dbd13ff tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.095s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:48 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c7fba6c0-2937-41e4-9cc4-eaae8dbd13ff tempest-VolumesSnapshotTestJSON-1235651696 None] Create snapshot completed successfully Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Flow 'volume_create_manager' (8c2458b0-b935-4e85-b833-caecaaa8df8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1be2b3d-4945-41db-852e-5742c3e3ca4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1be2b3d-4945-41db-852e-5742c3e3ca4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1518073161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244cd242-669d-4942-8fe3-b83dae150db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af9d5be839424abca1f4bf7fae0b2767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2eb1d396-9923-421e-9474-8585c3e59b8f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:50:50Z,use_quota=True,user_id='2a799329e47e4f5ebf2f31f27dba2465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552ebe7d-83c4-40b3-9956-5e1cdd6e60dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552ebe7d-83c4-40b3-9956-5e1cdd6e60dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8af78fb-f568-4a70-8521-925ae980f057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8af78fb-f568-4a70-8521-925ae980f057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '244cd242-669d-4942-8fe3-b83dae150db4', 'volume_name': 'volume-244cd242-669d-4942-8fe3-b83dae150db4', 'volume_size': 1, 'snapshot_id': '2eb1d396-9923-421e-9474-8585c3e59b8f'}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9311ca-e88b-4143-852f-5d32b0df40d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9311ca-e88b-4143-852f-5d32b0df40d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1f2234-be89-4a1a-9c1e-1d7b01b75192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:50 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Volume 244cd242-669d-4942-8fe3-b83dae150db4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-244cd242-669d-4942-8fe3-b83dae150db4', 'volume_size': 1, 'snapshot_id': '2eb1d396-9923-421e-9474-8585c3e59b8f'} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-quobyte-2eb1d396-9923-421e-9474-8585c3e59b8f-244cd242-669d-4942-8fe3-b83dae150db4" by "_create_volume_from_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-2eb1d396-9923-421e-9474-8585c3e59b8f-244cd242-669d-4942-8fe3-b83dae150db4" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Creating volume 244cd242-669d-4942-8fe3-b83dae150db4 from snapshot 2eb1d396-9923-421e-9474-8585c3e59b8f {{(pid=87359) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-quobyte-244cd242-669d-4942-8fe3-b83dae150db4" by "_copy_volume_from_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-244cd242-669d-4942-8fe3-b83dae150db4" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] snapshot: 2eb1d396-9923-421e-9474-8585c3e59b8f, volume: 244cd242-669d-4942-8fe3-b83dae150db4, {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ba4b15-0f5f-469d-a51d-07c514969c28]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:50 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f Jul 10 04:50:50 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:51 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f" returned: 0 in 0.718s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:51 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be0d7822-98a4-45b9-b474-0922fb6c4621(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:50:51 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621 {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 04:50:51 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Creating direct copy from snapshot {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 04:50:51 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[0993b1e1-9692-4993-9679-13991ee4e212]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:51 devstack sudo[101890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621 Jul 10 04:50:51 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:51 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621" returned: 0 in 0.746s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:51 devstack cinder-volume[87359]: DEBUG cinder.utils [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Path /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-244cd242-669d-4942-8fe3-b83dae150db4 not found in is_blk_device check {{(pid=87359) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 04:50:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-244cd242-669d-4942-8fe3-b83dae150db4 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:51 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-244cd242-669d-4942-8fe3-b83dae150db4 Jul 10 04:50:51 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:56 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-244cd242-669d-4942-8fe3-b83dae150db4" returned: 0 in 4.399s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:56 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbc9128-0ad0-4ffe-b5a4-ca0fe2df9855]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:56 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621 Jul 10 04:50:56 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:57 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621" returned: 0 in 0.949s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:57 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621, size 1024.00 MB, duration 4.40 sec, destination /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-244cd242-669d-4942-8fe3-b83dae150db4 {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:50:57 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Converted 1024.00 MB image at 232.70 MB/s Jul 10 04:50:57 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-244cd242-669d-4942-8fe3-b83dae150db4 is being set with open permissions: ugo+rw Jul 10 04:50:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-244cd242-669d-4942-8fe3-b83dae150db4 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:57 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-244cd242-669d-4942-8fe3-b83dae150db4 Jul 10 04:50:57 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:57 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-244cd242-669d-4942-8fe3-b83dae150db4" returned: 0 in 0.639s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-244cd242-669d-4942-8fe3-b83dae150db4" released by "_copy_volume_from_snapshot" :: held 7.536s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-2eb1d396-9923-421e-9474-8585c3e59b8f-244cd242-669d-4942-8fe3-b83dae150db4" released by "_create_volume_from_snapshot" :: held 7.564s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.579s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:57 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=50,cinder:SELECT=54,cinder:INSERT=11,cinder:DELETE=4 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:50:57 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1f2234-be89-4a1a-9c1e-1d7b01b75192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-244cd242-669d-4942-8fe3-b83dae150db4', 'volume_size': 1, 'snapshot_id': '2eb1d396-9923-421e-9474-8585c3e59b8f'}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:57 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a42752-562b-4061-996e-557b96f284d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:57 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Volume volume-244cd242-669d-4942-8fe3-b83dae150db4 (244cd242-669d-4942-8fe3-b83dae150db4): created successfully Jul 10 04:50:57 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a42752-562b-4061-996e-557b96f284d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:57 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Flow 'volume_create_manager' (8c2458b0-b935-4e85-b833-caecaaa8df8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:50:57 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a59bfbdd-86f0-4835-b567-58fe47f1ff73 tempest-VolumesSnapshotTestJSON-1235651696 None] Created volume successfully. Jul 10 04:50:58 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c9854534-2b45-43fd-bccb-ded1dd5578ae tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-244cd242-669d-4942-8fe3-b83dae150db4-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:58 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c9854534-2b45-43fd-bccb-ded1dd5578ae tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-244cd242-669d-4942-8fe3-b83dae150db4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:58 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c9854534-2b45-43fd-bccb-ded1dd5578ae tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-quobyte-244cd242-669d-4942-8fe3-b83dae150db4" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:58 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c9854534-2b45-43fd-bccb-ded1dd5578ae tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-244cd242-669d-4942-8fe3-b83dae150db4" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:59 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[97592b53-7d32-45dc-b89e-c5c852c7c107]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c9854534-2b45-43fd-bccb-ded1dd5578ae tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-244cd242-669d-4942-8fe3-b83dae150db4 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:59 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-244cd242-669d-4942-8fe3-b83dae150db4 Jul 10 04:50:59 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:59 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c9854534-2b45-43fd-bccb-ded1dd5578ae tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-244cd242-669d-4942-8fe3-b83dae150db4" returned: 0 in 0.737s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c9854534-2b45-43fd-bccb-ded1dd5578ae tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-244cd242-669d-4942-8fe3-b83dae150db4 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:59 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-244cd242-669d-4942-8fe3-b83dae150db4 Jul 10 04:50:59 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:00 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c9854534-2b45-43fd-bccb-ded1dd5578ae tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-244cd242-669d-4942-8fe3-b83dae150db4" returned: 0 in 0.673s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:00 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c9854534-2b45-43fd-bccb-ded1dd5578ae tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-244cd242-669d-4942-8fe3-b83dae150db4" released by "delete_volume" :: held 1.450s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:00 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-c9854534-2b45-43fd-bccb-ded1dd5578ae tempest-VolumesSnapshotTestJSON-1235651696 None] Created reservations ['c5b17b68-ca20-4752-b582-bafd9e278b3e', '9538fc79-db09-422a-a9e2-bd246884620f', '003a75c6-54a4-4b19-9ed3-9fdd78268a7f', '0ae09ed4-2571-4a3d-8a91-61c58843ffa0'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:51:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c9854534-2b45-43fd-bccb-ded1dd5578ae tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c9854534-2b45-43fd-bccb-ded1dd5578ae tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c9854534-2b45-43fd-bccb-ded1dd5578ae tempest-VolumesSnapshotTestJSON-1235651696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:51:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c9854534-2b45-43fd-bccb-ded1dd5578ae tempest-VolumesSnapshotTestJSON-1235651696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:51:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c9854534-2b45-43fd-bccb-ded1dd5578ae tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c9854534-2b45-43fd-bccb-ded1dd5578ae tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:00 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:51:00 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-629c84ac-db27-4838-9ab1-1eac849e353e tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-2eb1d396-9923-421e-9474-8585c3e59b8f-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-629c84ac-db27-4838-9ab1-1eac849e353e tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-2eb1d396-9923-421e-9474-8585c3e59b8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-629c84ac-db27-4838-9ab1-1eac849e353e tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-quobyte-be0d7822-98a4-45b9-b474-0922fb6c4621" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-629c84ac-db27-4838-9ab1-1eac849e353e tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-be0d7822-98a4-45b9-b474-0922fb6c4621" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-629c84ac-db27-4838-9ab1-1eac849e353e tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-quobyte-2eb1d396-9923-421e-9474-8585c3e59b8f" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:01 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-629c84ac-db27-4838-9ab1-1eac849e353e tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-2eb1d396-9923-421e-9474-8585c3e59b8f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-629c84ac-db27-4838-9ab1-1eac849e353e tempest-VolumesSnapshotTestJSON-1235651696 None] Deleting offline snapshot 2eb1d396-9923-421e-9474-8585c3e59b8f of volume be0d7822-98a4-45b9-b474-0922fb6c4621 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:51:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-629c84ac-db27-4838-9ab1-1eac849e353e tempest-VolumesSnapshotTestJSON-1235651696 None] snapshot_file for this snap is: volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:51:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c9854534-2b45-43fd-bccb-ded1dd5578ae tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.719s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:01 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-c9854534-2b45-43fd-bccb-ded1dd5578ae tempest-VolumesSnapshotTestJSON-1235651696 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:51:01 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c9854534-2b45-43fd-bccb-ded1dd5578ae tempest-VolumesSnapshotTestJSON-1235651696 None] Deleted volume successfully. Jul 10 04:51:01 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94a6e07-86a8-4c73-9988-354f50f1201d]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-629c84ac-db27-4838-9ab1-1eac849e353e tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c9854534-2b45-43fd-bccb-ded1dd5578ae tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-244cd242-669d-4942-8fe3-b83dae150db4-delete_volume" released by "delete_volume" :: held 2.356s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:01 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f Jul 10 04:51:01 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:01 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-629c84ac-db27-4838-9ab1-1eac849e353e tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f" returned: 0 in 0.733s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-629c84ac-db27-4838-9ab1-1eac849e353e tempest-VolumesSnapshotTestJSON-1235651696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be0d7822-98a4-45b9-b474-0922fb6c4621(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:51:02 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58f2e8f-e720-4a7e-9e98-3a8c0c681977]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-629c84ac-db27-4838-9ab1-1eac849e353e tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:02 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621 Jul 10 04:51:02 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:02 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-629c84ac-db27-4838-9ab1-1eac849e353e tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621" returned: 0 in 0.726s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-629c84ac-db27-4838-9ab1-1eac849e353e tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:02 devstack sudo[101938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f Jul 10 04:51:02 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:03 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-629c84ac-db27-4838-9ab1-1eac849e353e tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f" returned: 0 in 0.733s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-629c84ac-db27-4838-9ab1-1eac849e353e tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:03 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f Jul 10 04:51:03 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:04 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-629c84ac-db27-4838-9ab1-1eac849e353e tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621.2eb1d396-9923-421e-9474-8585c3e59b8f" returned: 0 in 0.632s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-629c84ac-db27-4838-9ab1-1eac849e353e tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-2eb1d396-9923-421e-9474-8585c3e59b8f" released by "_delete_snapshot" :: held 2.918s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-629c84ac-db27-4838-9ab1-1eac849e353e tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-be0d7822-98a4-45b9-b474-0922fb6c4621" released by "delete_snapshot" :: held 2.938s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:04 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-629c84ac-db27-4838-9ab1-1eac849e353e tempest-VolumesSnapshotTestJSON-1235651696 None] Created reservations ['b90d4b21-da26-4fe5-9906-e1e6fd140df7', '80aee042-68ee-451d-a304-f80190dd29ea', '7e99c8d2-4e17-41f9-b7b2-904b919942ac', 'afeac6c7-0bdf-4a1d-a783-3082fbd52c9c'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:51:04 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-629c84ac-db27-4838-9ab1-1eac849e353e tempest-VolumesSnapshotTestJSON-1235651696 None] Delete snapshot completed successfully. Jul 10 04:51:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-629c84ac-db27-4838-9ab1-1eac849e353e tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-2eb1d396-9923-421e-9474-8585c3e59b8f-delete_snapshot" released by "delete_snapshot" :: held 3.065s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-df64974b-1457-4b9f-ab24-87d0c0ef0725 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-be0d7822-98a4-45b9-b474-0922fb6c4621-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-df64974b-1457-4b9f-ab24-87d0c0ef0725 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-be0d7822-98a4-45b9-b474-0922fb6c4621-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-df64974b-1457-4b9f-ab24-87d0c0ef0725 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-quobyte-be0d7822-98a4-45b9-b474-0922fb6c4621" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-df64974b-1457-4b9f-ab24-87d0c0ef0725 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-be0d7822-98a4-45b9-b474-0922fb6c4621" acquired by "delete_volume" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:04 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[986230e5-635e-473c-8c7f-2e046c8f9b29]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-df64974b-1457-4b9f-ab24-87d0c0ef0725 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:04 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621 Jul 10 04:51:04 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:05 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-df64974b-1457-4b9f-ab24-87d0c0ef0725 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621" returned: 0 in 0.729s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-df64974b-1457-4b9f-ab24-87d0c0ef0725 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:05 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621 Jul 10 04:51:05 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:05 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-df64974b-1457-4b9f-ab24-87d0c0ef0725 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-be0d7822-98a4-45b9-b474-0922fb6c4621" returned: 0 in 0.632s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-df64974b-1457-4b9f-ab24-87d0c0ef0725 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-be0d7822-98a4-45b9-b474-0922fb6c4621" released by "delete_volume" :: held 1.417s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:05 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-df64974b-1457-4b9f-ab24-87d0c0ef0725 tempest-VolumesSnapshotTestJSON-1235651696 None] Created reservations ['26882129-abe1-4724-aaf3-8877c1ce6e1d', '1bd2a807-847d-444e-9ab6-112256afa3e3', '8d928a7f-d025-4ea1-94d9-c78f4d5890c9', '98f92646-05eb-4b43-b91b-2a10469611f3'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:51:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-df64974b-1457-4b9f-ab24-87d0c0ef0725 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-df64974b-1457-4b9f-ab24-87d0c0ef0725 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-df64974b-1457-4b9f-ab24-87d0c0ef0725 tempest-VolumesSnapshotTestJSON-1235651696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:51:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-df64974b-1457-4b9f-ab24-87d0c0ef0725 tempest-VolumesSnapshotTestJSON-1235651696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:51:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-df64974b-1457-4b9f-ab24-87d0c0ef0725 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-df64974b-1457-4b9f-ab24-87d0c0ef0725 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:06 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:51:06 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ed189b2c-7d88-4659-ad7e-9152ff701360 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-365769f8-a9cd-443b-bde9-b9235fd5d551-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:06 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-df64974b-1457-4b9f-ab24-87d0c0ef0725 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.704s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:06 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-df64974b-1457-4b9f-ab24-87d0c0ef0725 tempest-VolumesSnapshotTestJSON-1235651696 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:51:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ed189b2c-7d88-4659-ad7e-9152ff701360 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-365769f8-a9cd-443b-bde9-b9235fd5d551-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:06 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-df64974b-1457-4b9f-ab24-87d0c0ef0725 tempest-VolumesSnapshotTestJSON-1235651696 None] Deleted volume successfully. Jul 10 04:51:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-df64974b-1457-4b9f-ab24-87d0c0ef0725 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-be0d7822-98a4-45b9-b474-0922fb6c4621-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ed189b2c-7d88-4659-ad7e-9152ff701360 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "cinder-quobyte-365769f8-a9cd-443b-bde9-b9235fd5d551" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ed189b2c-7d88-4659-ad7e-9152ff701360 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-365769f8-a9cd-443b-bde9-b9235fd5d551" acquired by "delete_volume" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:06 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7468e4-4315-47e5-b2ad-cb4191e5c059]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ed189b2c-7d88-4659-ad7e-9152ff701360 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:06 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551 Jul 10 04:51:06 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:07 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ed189b2c-7d88-4659-ad7e-9152ff701360 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551" returned: 0 in 0.763s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ed189b2c-7d88-4659-ad7e-9152ff701360 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:07 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551 Jul 10 04:51:07 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:08 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ed189b2c-7d88-4659-ad7e-9152ff701360 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365769f8-a9cd-443b-bde9-b9235fd5d551" returned: 0 in 0.668s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ed189b2c-7d88-4659-ad7e-9152ff701360 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-quobyte-365769f8-a9cd-443b-bde9-b9235fd5d551" released by "delete_volume" :: held 1.484s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:08 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-ed189b2c-7d88-4659-ad7e-9152ff701360 tempest-VolumesSnapshotTestJSON-1235651696 None] Created reservations ['377fbcd6-d93f-4282-a80a-20849536ffd7', '29bb7c61-4275-4be6-a538-3898325439c6', 'a8247284-2a8b-4989-b461-0117d2ed5159', 'd59c8495-c053-4559-8345-05b7d1cf24d5'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:51:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ed189b2c-7d88-4659-ad7e-9152ff701360 tempest-VolumesSnapshotTestJSON-1235651696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ed189b2c-7d88-4659-ad7e-9152ff701360 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ed189b2c-7d88-4659-ad7e-9152ff701360 tempest-VolumesSnapshotTestJSON-1235651696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:51:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ed189b2c-7d88-4659-ad7e-9152ff701360 tempest-VolumesSnapshotTestJSON-1235651696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:51:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ed189b2c-7d88-4659-ad7e-9152ff701360 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ed189b2c-7d88-4659-ad7e-9152ff701360 tempest-VolumesSnapshotTestJSON-1235651696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:08 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:51:08 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:09 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ed189b2c-7d88-4659-ad7e-9152ff701360 tempest-VolumesSnapshotTestJSON-1235651696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.643s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:09 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-ed189b2c-7d88-4659-ad7e-9152ff701360 tempest-VolumesSnapshotTestJSON-1235651696 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:51:09 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ed189b2c-7d88-4659-ad7e-9152ff701360 tempest-VolumesSnapshotTestJSON-1235651696 None] Deleted volume successfully. Jul 10 04:51:09 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ed189b2c-7d88-4659-ad7e-9152ff701360 tempest-VolumesSnapshotTestJSON-1235651696 None] Lock "cinder-365769f8-a9cd-443b-bde9-b9235fd5d551-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Flow 'volume_create_manager' (d6356c6e-76be-4f33-869b-781f8b328387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3338bb2-7fdc-45a5-b132-838042697c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3338bb2-7fdc-45a5-b132-838042697c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1967536590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29670567-04b5-4aab-96e2-27db25afeecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347698aaacbb4408a7a713ae88b7063c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:51:14Z,use_quota=True,user_id='362103ea43574f898dcc35ec7b7b8395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb67f322-ead0-435e-abdc-12e784fab05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb67f322-ead0-435e-abdc-12e784fab05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c2801e-e450-41d1-9953-5c218c2ac0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c2801e-e450-41d1-9953-5c218c2ac0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29670567-04b5-4aab-96e2-27db25afeecd', 'volume_name': 'volume-29670567-04b5-4aab-96e2-27db25afeecd', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3f4f8e-8b0b-4359-b67f-553bc6c7bc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3f4f8e-8b0b-4359-b67f-553bc6c7bc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c832fe8f-c284-420f-ad1f-b9dcb88590e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:14 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Volume 29670567-04b5-4aab-96e2-27db25afeecd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29670567-04b5-4aab-96e2-27db25afeecd', 'volume_size': 1} Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1967536590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29670567-04b5-4aab-96e2-27db25afeecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347698aaacbb4408a7a713ae88b7063c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:51:14Z,use_quota=True,user_id='362103ea43574f898dcc35ec7b7b8395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Creating volume 29670567-04b5-4aab-96e2-27db25afeecd {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:51:14 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:14 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd 1073741824 Jul 10 04:51:14 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:14 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd 1073741824" returned: 0 in 0.796s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:15 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd Jul 10 04:51:15 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:15 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd" returned: 0 in 0.619s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:51:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:15 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c832fe8f-c284-420f-ad1f-b9dcb88590e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29670567-04b5-4aab-96e2-27db25afeecd', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:15 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf370d61-0e69-4666-a822-23eec30ac276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:15 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Volume volume-29670567-04b5-4aab-96e2-27db25afeecd (29670567-04b5-4aab-96e2-27db25afeecd): created successfully Jul 10 04:51:15 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf370d61-0e69-4666-a822-23eec30ac276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:15 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Flow 'volume_create_manager' (d6356c6e-76be-4f33-869b-781f8b328387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:51:15 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ab223a24-6b91-4f59-a661-fbb22ad55b70 tempest-VolumesSnapshotListTestJSON-1564709422 None] Created volume successfully. Jul 10 04:51:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:51:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:51:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:51:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:15 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:51:15 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ec0e97ba-fe51-493b-9971-684fdab475c5 tempest-VolumesSnapshotListTestJSON-1564709422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ec0e97ba-fe51-493b-9971-684fdab475c5 tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:16 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-ec0e97ba-fe51-493b-9971-684fdab475c5 tempest-VolumesSnapshotListTestJSON-1564709422 None] Creating offline snapshot d0e60208-6526-4416-8a6c-571aaa43c167 of volume 29670567-04b5-4aab-96e2-27db25afeecd {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:51:16 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b13c950-ffdc-4f52-8b6a-939a5af1a254]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec0e97ba-fe51-493b-9971-684fdab475c5 tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:16 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd Jul 10 04:51:16 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:16 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.663s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:51:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:51:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:51:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:51:17 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec0e97ba-fe51-493b-9971-684fdab475c5 tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd" returned: 0 in 0.751s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec0e97ba-fe51-493b-9971-684fdab475c5 tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:17 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167 1G Jul 10 04:51:17 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:17 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec0e97ba-fe51-493b-9971-684fdab475c5 tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167 1G" returned: 0 in 0.762s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec0e97ba-fe51-493b-9971-684fdab475c5 tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29670567-04b5-4aab-96e2-27db25afeecd -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:17 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29670567-04b5-4aab-96e2-27db25afeecd -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167 Jul 10 04:51:17 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:18 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec0e97ba-fe51-493b-9971-684fdab475c5 tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29670567-04b5-4aab-96e2-27db25afeecd -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167" returned: 0 in 0.652s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:18 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-ec0e97ba-fe51-493b-9971-684fdab475c5 tempest-VolumesSnapshotListTestJSON-1564709422 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167 is being set with open permissions: ugo+rw Jul 10 04:51:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec0e97ba-fe51-493b-9971-684fdab475c5 tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:18 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167 Jul 10 04:51:18 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:19 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec0e97ba-fe51-493b-9971-684fdab475c5 tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167" returned: 0 in 0.624s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec0e97ba-fe51-493b-9971-684fdab475c5 tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:19 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.info Jul 10 04:51:19 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:19 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec0e97ba-fe51-493b-9971-684fdab475c5 tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.info" returned: 0 in 0.617s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:19 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-ec0e97ba-fe51-493b-9971-684fdab475c5 tempest-VolumesSnapshotListTestJSON-1564709422 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.info is being set with open permissions: ugo+rw Jul 10 04:51:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec0e97ba-fe51-493b-9971-684fdab475c5 tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:19 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.info Jul 10 04:51:19 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:20 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec0e97ba-fe51-493b-9971-684fdab475c5 tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.info" returned: 0 in 0.627s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ec0e97ba-fe51-493b-9971-684fdab475c5 tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.121s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:20 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ec0e97ba-fe51-493b-9971-684fdab475c5 tempest-VolumesSnapshotListTestJSON-1564709422 None] Create snapshot completed successfully Jul 10 04:51:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-391708c1-86c7-4b40-a746-a1df833a3f97 tempest-VolumesSnapshotListTestJSON-1564709422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-391708c1-86c7-4b40-a746-a1df833a3f97 tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-391708c1-86c7-4b40-a746-a1df833a3f97 tempest-VolumesSnapshotListTestJSON-1564709422 None] Creating offline snapshot daedbf10-97e3-4b0f-92d4-74975ea7d788 of volume 29670567-04b5-4aab-96e2-27db25afeecd {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:51:21 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[c541bc85-5a47-4ac9-a4dc-d3123d2388ec]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-391708c1-86c7-4b40-a746-a1df833a3f97 tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:21 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167 Jul 10 04:51:21 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:22 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-391708c1-86c7-4b40-a746-a1df833a3f97 tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167" returned: 0 in 0.734s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-391708c1-86c7-4b40-a746-a1df833a3f97 tempest-VolumesSnapshotListTestJSON-1564709422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29670567-04b5-4aab-96e2-27db25afeecd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:51:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-391708c1-86c7-4b40-a746-a1df833a3f97 tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:22 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788 1G Jul 10 04:51:22 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:23 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-391708c1-86c7-4b40-a746-a1df833a3f97 tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788 1G" returned: 0 in 0.779s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-391708c1-86c7-4b40-a746-a1df833a3f97 tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:23 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788 Jul 10 04:51:23 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:23 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-391708c1-86c7-4b40-a746-a1df833a3f97 tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788" returned: 0 in 0.658s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:23 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-391708c1-86c7-4b40-a746-a1df833a3f97 tempest-VolumesSnapshotListTestJSON-1564709422 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788 is being set with open permissions: ugo+rw Jul 10 04:51:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-391708c1-86c7-4b40-a746-a1df833a3f97 tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:23 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788 Jul 10 04:51:23 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:24 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-391708c1-86c7-4b40-a746-a1df833a3f97 tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788" returned: 0 in 0.608s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-391708c1-86c7-4b40-a746-a1df833a3f97 tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.858s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:24 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-391708c1-86c7-4b40-a746-a1df833a3f97 tempest-VolumesSnapshotListTestJSON-1564709422 None] Create snapshot completed successfully Jul 10 04:51:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-177feed8-23b8-4fae-8471-cead355557b8 tempest-VolumesSnapshotListTestJSON-1564709422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-177feed8-23b8-4fae-8471-cead355557b8 tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-177feed8-23b8-4fae-8471-cead355557b8 tempest-VolumesSnapshotListTestJSON-1564709422 None] Creating offline snapshot 31b91295-7d77-44eb-88d3-8d03f5d044d1 of volume 29670567-04b5-4aab-96e2-27db25afeecd {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:51:24 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb47e7cc-73af-471e-926f-3ee50c8b0915]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-177feed8-23b8-4fae-8471-cead355557b8 tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:25 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788 Jul 10 04:51:25 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:25 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-177feed8-23b8-4fae-8471-cead355557b8 tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788" returned: 0 in 0.704s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-177feed8-23b8-4fae-8471-cead355557b8 tempest-VolumesSnapshotListTestJSON-1564709422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29670567-04b5-4aab-96e2-27db25afeecd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:51:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-177feed8-23b8-4fae-8471-cead355557b8 tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.31b91295-7d77-44eb-88d3-8d03f5d044d1 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:25 devstack sudo[102077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.31b91295-7d77-44eb-88d3-8d03f5d044d1 1G Jul 10 04:51:25 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:26 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-177feed8-23b8-4fae-8471-cead355557b8 tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.31b91295-7d77-44eb-88d3-8d03f5d044d1 1G" returned: 0 in 0.792s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-177feed8-23b8-4fae-8471-cead355557b8 tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.31b91295-7d77-44eb-88d3-8d03f5d044d1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:26 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.31b91295-7d77-44eb-88d3-8d03f5d044d1 Jul 10 04:51:26 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:27 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-177feed8-23b8-4fae-8471-cead355557b8 tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.31b91295-7d77-44eb-88d3-8d03f5d044d1" returned: 0 in 0.643s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:27 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-177feed8-23b8-4fae-8471-cead355557b8 tempest-VolumesSnapshotListTestJSON-1564709422 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.31b91295-7d77-44eb-88d3-8d03f5d044d1 is being set with open permissions: ugo+rw Jul 10 04:51:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-177feed8-23b8-4fae-8471-cead355557b8 tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.31b91295-7d77-44eb-88d3-8d03f5d044d1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:27 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.31b91295-7d77-44eb-88d3-8d03f5d044d1 Jul 10 04:51:27 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:27 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-177feed8-23b8-4fae-8471-cead355557b8 tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.31b91295-7d77-44eb-88d3-8d03f5d044d1" returned: 0 in 0.625s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:27 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=53,cinder:UPDATE=69,cinder:INSERT=15,cinder:DELETE=9 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:51:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-177feed8-23b8-4fae-8471-cead355557b8 tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.851s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:27 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-177feed8-23b8-4fae-8471-cead355557b8 tempest-VolumesSnapshotListTestJSON-1564709422 None] Create snapshot completed successfully Jul 10 04:51:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] Acquiring lock "cinder-31b91295-7d77-44eb-88d3-8d03f5d044d1-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "cinder-31b91295-7d77-44eb-88d3-8d03f5d044d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] Acquiring lock "cinder-quobyte-29670567-04b5-4aab-96e2-27db25afeecd" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "cinder-quobyte-29670567-04b5-4aab-96e2-27db25afeecd" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] Acquiring lock "cinder-quobyte-31b91295-7d77-44eb-88d3-8d03f5d044d1" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "cinder-quobyte-31b91295-7d77-44eb-88d3-8d03f5d044d1" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] Deleting offline snapshot 31b91295-7d77-44eb-88d3-8d03f5d044d1 of volume 29670567-04b5-4aab-96e2-27db25afeecd {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:51:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] snapshot_file for this snap is: volume-29670567-04b5-4aab-96e2-27db25afeecd.31b91295-7d77-44eb-88d3-8d03f5d044d1 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:51:28 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8637664-ad77-4798-b8fd-aeee4d53cc5c]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.31b91295-7d77-44eb-88d3-8d03f5d044d1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:29 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.31b91295-7d77-44eb-88d3-8d03f5d044d1 Jul 10 04:51:29 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:29 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.31b91295-7d77-44eb-88d3-8d03f5d044d1" returned: 0 in 0.748s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29670567-04b5-4aab-96e2-27db25afeecd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:51:29 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9eb838d-78e9-452c-b521-5c6acc34d902]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:29 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788 Jul 10 04:51:29 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:30 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788" returned: 0 in 0.730s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:30 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29670567-04b5-4aab-96e2-27db25afeecd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:51:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.31b91295-7d77-44eb-88d3-8d03f5d044d1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:30 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.31b91295-7d77-44eb-88d3-8d03f5d044d1 Jul 10 04:51:30 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:31 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.31b91295-7d77-44eb-88d3-8d03f5d044d1" returned: 0 in 0.757s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.31b91295-7d77-44eb-88d3-8d03f5d044d1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:31 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.31b91295-7d77-44eb-88d3-8d03f5d044d1 Jul 10 04:51:31 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:31 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.31b91295-7d77-44eb-88d3-8d03f5d044d1" returned: 0 in 0.616s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:31 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "cinder-quobyte-31b91295-7d77-44eb-88d3-8d03f5d044d1" released by "_delete_snapshot" :: held 2.939s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:31 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "cinder-quobyte-29670567-04b5-4aab-96e2-27db25afeecd" released by "delete_snapshot" :: held 2.958s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:31 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] Created reservations ['777e2464-a15c-4e04-a0d6-8a6cb269920d', 'bab34a4f-b18b-4400-a7db-45c816f78775', '53709a56-cbc7-40b4-9520-5dc85aa8f52a', 'd4dfcd39-7287-4f29-aca1-2adf4deb2215'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:51:31 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] Delete snapshot completed successfully. Jul 10 04:51:31 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-94e6f65d-6401-40c3-bde8-3d3336b0f82a tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "cinder-31b91295-7d77-44eb-88d3-8d03f5d044d1-delete_snapshot" released by "delete_snapshot" :: held 3.079s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] Acquiring lock "cinder-daedbf10-97e3-4b0f-92d4-74975ea7d788-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "cinder-daedbf10-97e3-4b0f-92d4-74975ea7d788-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] Acquiring lock "cinder-quobyte-29670567-04b5-4aab-96e2-27db25afeecd" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "cinder-quobyte-29670567-04b5-4aab-96e2-27db25afeecd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] Acquiring lock "cinder-quobyte-daedbf10-97e3-4b0f-92d4-74975ea7d788" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "cinder-quobyte-daedbf10-97e3-4b0f-92d4-74975ea7d788" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] Deleting offline snapshot daedbf10-97e3-4b0f-92d4-74975ea7d788 of volume 29670567-04b5-4aab-96e2-27db25afeecd {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:51:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] snapshot_file for this snap is: volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:51:32 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[0799a11d-0593-4f93-93a8-a38557d25572]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:32 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788 Jul 10 04:51:32 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:32 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788" returned: 0 in 0.726s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29670567-04b5-4aab-96e2-27db25afeecd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:51:32 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c679c9-3ee3-40c3-aac9-3f33ae304015]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:33 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167 Jul 10 04:51:33 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:33 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167" returned: 0 in 0.723s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29670567-04b5-4aab-96e2-27db25afeecd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:51:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:33 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788 Jul 10 04:51:33 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:34 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788" returned: 0 in 0.721s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:34 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788 Jul 10 04:51:34 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:34 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.daedbf10-97e3-4b0f-92d4-74975ea7d788" returned: 0 in 0.603s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "cinder-quobyte-daedbf10-97e3-4b0f-92d4-74975ea7d788" released by "_delete_snapshot" :: held 2.856s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "cinder-quobyte-29670567-04b5-4aab-96e2-27db25afeecd" released by "delete_snapshot" :: held 2.880s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:35 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] Created reservations ['c2ff5593-9817-4fe5-ad4a-e1ab5b46aa16', '68ec89cd-7bb3-4f37-a5f2-11ab322ce79a', 'b7fa9eae-73a1-4986-92b5-7deb05eee9fa', '5ae3908d-8c04-4fdf-a0de-eb48fa15cf28'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:51:35 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] Delete snapshot completed successfully. Jul 10 04:51:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a958fcd4-6779-4e3e-838a-1270edde1d0e tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "cinder-daedbf10-97e3-4b0f-92d4-74975ea7d788-delete_snapshot" released by "delete_snapshot" :: held 3.000s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6355426d-92ef-4f73-bb72-d32886afcb7b tempest-VolumesSnapshotListTestJSON-1564709422 None] Acquiring lock "cinder-d0e60208-6526-4416-8a6c-571aaa43c167-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6355426d-92ef-4f73-bb72-d32886afcb7b tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "cinder-d0e60208-6526-4416-8a6c-571aaa43c167-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6355426d-92ef-4f73-bb72-d32886afcb7b tempest-VolumesSnapshotListTestJSON-1564709422 None] Acquiring lock "cinder-quobyte-29670567-04b5-4aab-96e2-27db25afeecd" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6355426d-92ef-4f73-bb72-d32886afcb7b tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "cinder-quobyte-29670567-04b5-4aab-96e2-27db25afeecd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6355426d-92ef-4f73-bb72-d32886afcb7b tempest-VolumesSnapshotListTestJSON-1564709422 None] Acquiring lock "cinder-quobyte-d0e60208-6526-4416-8a6c-571aaa43c167" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6355426d-92ef-4f73-bb72-d32886afcb7b tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "cinder-quobyte-d0e60208-6526-4416-8a6c-571aaa43c167" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-6355426d-92ef-4f73-bb72-d32886afcb7b tempest-VolumesSnapshotListTestJSON-1564709422 None] Deleting offline snapshot d0e60208-6526-4416-8a6c-571aaa43c167 of volume 29670567-04b5-4aab-96e2-27db25afeecd {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:51:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-6355426d-92ef-4f73-bb72-d32886afcb7b tempest-VolumesSnapshotListTestJSON-1564709422 None] snapshot_file for this snap is: volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:51:35 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f656ed-4478-453a-8dac-c4b8f4195722]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6355426d-92ef-4f73-bb72-d32886afcb7b tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:35 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167 Jul 10 04:51:35 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:36 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6355426d-92ef-4f73-bb72-d32886afcb7b tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167" returned: 0 in 0.709s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:36 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-6355426d-92ef-4f73-bb72-d32886afcb7b tempest-VolumesSnapshotListTestJSON-1564709422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29670567-04b5-4aab-96e2-27db25afeecd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:51:36 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[27867517-a434-4fc9-a968-de0c7a3c7736]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6355426d-92ef-4f73-bb72-d32886afcb7b tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:36 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd Jul 10 04:51:36 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:36 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6355426d-92ef-4f73-bb72-d32886afcb7b tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd" returned: 0 in 0.709s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6355426d-92ef-4f73-bb72-d32886afcb7b tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:36 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167 Jul 10 04:51:36 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:37 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6355426d-92ef-4f73-bb72-d32886afcb7b tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167" returned: 0 in 0.687s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6355426d-92ef-4f73-bb72-d32886afcb7b tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:37 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167 Jul 10 04:51:37 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:38 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6355426d-92ef-4f73-bb72-d32886afcb7b tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd.d0e60208-6526-4416-8a6c-571aaa43c167" returned: 0 in 0.614s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6355426d-92ef-4f73-bb72-d32886afcb7b tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "cinder-quobyte-d0e60208-6526-4416-8a6c-571aaa43c167" released by "_delete_snapshot" :: held 2.806s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6355426d-92ef-4f73-bb72-d32886afcb7b tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "cinder-quobyte-29670567-04b5-4aab-96e2-27db25afeecd" released by "delete_snapshot" :: held 2.826s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:38 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-6355426d-92ef-4f73-bb72-d32886afcb7b tempest-VolumesSnapshotListTestJSON-1564709422 None] Created reservations ['89d0e741-5404-4544-8676-3e1220fa5efe', '12cc3c82-fce4-4f74-b9dc-cfd226a7f043', 'fbcd251a-ca14-42f8-a944-5648a77b1657', 'f5e778a1-5fe0-4b72-9fcc-ae7017a6f5a9'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:51:38 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-6355426d-92ef-4f73-bb72-d32886afcb7b tempest-VolumesSnapshotListTestJSON-1564709422 None] Delete snapshot completed successfully. Jul 10 04:51:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6355426d-92ef-4f73-bb72-d32886afcb7b tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "cinder-d0e60208-6526-4416-8a6c-571aaa43c167-delete_snapshot" released by "delete_snapshot" :: held 2.955s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8daa3e79-a505-4d23-abb1-c2f2fe817b95 tempest-VolumesSnapshotListTestJSON-1564709422 None] Acquiring lock "cinder-29670567-04b5-4aab-96e2-27db25afeecd-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8daa3e79-a505-4d23-abb1-c2f2fe817b95 tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "cinder-29670567-04b5-4aab-96e2-27db25afeecd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8daa3e79-a505-4d23-abb1-c2f2fe817b95 tempest-VolumesSnapshotListTestJSON-1564709422 None] Acquiring lock "cinder-quobyte-29670567-04b5-4aab-96e2-27db25afeecd" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8daa3e79-a505-4d23-abb1-c2f2fe817b95 tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "cinder-quobyte-29670567-04b5-4aab-96e2-27db25afeecd" acquired by "delete_volume" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:38 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88df446-1489-471d-b97e-1a170c97bae9]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8daa3e79-a505-4d23-abb1-c2f2fe817b95 tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:38 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd Jul 10 04:51:38 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:39 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8daa3e79-a505-4d23-abb1-c2f2fe817b95 tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd" returned: 0 in 0.739s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8daa3e79-a505-4d23-abb1-c2f2fe817b95 tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:39 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd Jul 10 04:51:39 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:39 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8daa3e79-a505-4d23-abb1-c2f2fe817b95 tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-29670567-04b5-4aab-96e2-27db25afeecd" returned: 0 in 0.618s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8daa3e79-a505-4d23-abb1-c2f2fe817b95 tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "cinder-quobyte-29670567-04b5-4aab-96e2-27db25afeecd" released by "delete_volume" :: held 1.407s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:39 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-8daa3e79-a505-4d23-abb1-c2f2fe817b95 tempest-VolumesSnapshotListTestJSON-1564709422 None] Created reservations ['ba6b9422-154e-4d8b-93ac-c753f04b164d', '1baa0fc0-ebfd-4d79-b422-5617d1a31637', 'a989d589-17c9-4960-b5ae-a65bdc43d0d2', '817da0ae-ba5d-44aa-8d03-42ddf3db6406'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:51:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8daa3e79-a505-4d23-abb1-c2f2fe817b95 tempest-VolumesSnapshotListTestJSON-1564709422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8daa3e79-a505-4d23-abb1-c2f2fe817b95 tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8daa3e79-a505-4d23-abb1-c2f2fe817b95 tempest-VolumesSnapshotListTestJSON-1564709422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:51:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8daa3e79-a505-4d23-abb1-c2f2fe817b95 tempest-VolumesSnapshotListTestJSON-1564709422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:51:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8daa3e79-a505-4d23-abb1-c2f2fe817b95 tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8daa3e79-a505-4d23-abb1-c2f2fe817b95 tempest-VolumesSnapshotListTestJSON-1564709422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:40 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:51:40 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:40 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8daa3e79-a505-4d23-abb1-c2f2fe817b95 tempest-VolumesSnapshotListTestJSON-1564709422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.614s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:40 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-8daa3e79-a505-4d23-abb1-c2f2fe817b95 tempest-VolumesSnapshotListTestJSON-1564709422 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:51:40 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-8daa3e79-a505-4d23-abb1-c2f2fe817b95 tempest-VolumesSnapshotListTestJSON-1564709422 None] Deleted volume successfully. Jul 10 04:51:40 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8daa3e79-a505-4d23-abb1-c2f2fe817b95 tempest-VolumesSnapshotListTestJSON-1564709422 None] Lock "cinder-29670567-04b5-4aab-96e2-27db25afeecd-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:43 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:51:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Flow 'volume_create_manager' (1dbe970d-6a0c-4281-a440-88ddd8c2edc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:51:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a1d011-d44f-42a7-9d96-50c355c233cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a1d011-d44f-42a7-9d96-50c355c233cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1056349130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d11fa23-5751-4418-b0a3-afbecec9d8cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79986b35610846f391907b54df7fbc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:51:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:51:43Z,use_quota=True,user_id='db4b228a2423436fbd43e20e68689cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b474d825-2176-4545-a17b-5f19b0aa0e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b474d825-2176-4545-a17b-5f19b0aa0e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (860bdc1e-ade3-4d0e-bc90-c4e33e0147de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (860bdc1e-ade3-4d0e-bc90-c4e33e0147de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d11fa23-5751-4418-b0a3-afbecec9d8cb', 'volume_name': 'volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb', 'volume_size': 2}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53b0218-ce35-4f80-a6a0-35972804dd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53b0218-ce35-4f80-a6a0-35972804dd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d324de-5f2e-47cf-9037-b67ac23b173c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:43 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Volume 3d11fa23-5751-4418-b0a3-afbecec9d8cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb', 'volume_size': 2} Jul 10 04:51:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:43 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1056349130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d11fa23-5751-4418-b0a3-afbecec9d8cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79986b35610846f391907b54df7fbc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:51:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:51:43Z,use_quota=True,user_id='db4b228a2423436fbd43e20e68689cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:51:43 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Creating volume 3d11fa23-5751-4418-b0a3-afbecec9d8cb {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:51:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:43 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:51:43 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:51:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:43 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:51:43 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:51:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb 2147483648 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:43 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb 2147483648 Jul 10 04:51:43 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:44 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb 2147483648" returned: 0 in 0.836s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:44 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb Jul 10 04:51:44 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:45 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb" returned: 0 in 0.623s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:45 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:51:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:45 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d324de-5f2e-47cf-9037-b67ac23b173c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb', 'volume_size': 2}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:45 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b08a8df-b433-4c87-9e46-576ca49a392f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:45 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Volume volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb (3d11fa23-5751-4418-b0a3-afbecec9d8cb): created successfully Jul 10 04:51:45 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b08a8df-b433-4c87-9e46-576ca49a392f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:45 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Flow 'volume_create_manager' (1dbe970d-6a0c-4281-a440-88ddd8c2edc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:51:45 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-3895352d-5cc6-4ecb-ad4e-9fc1a8c76b84 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Created volume successfully. Jul 10 04:51:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-bdc30cfb-9bd2-4cb7-833a-4ff6037555b9 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-bdc30cfb-9bd2-4cb7-833a-4ff6037555b9 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:45 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-bdc30cfb-9bd2-4cb7-833a-4ff6037555b9 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Creating offline snapshot 2004e45b-c669-4334-9802-16356d22c3a2 of volume 3d11fa23-5751-4418-b0a3-afbecec9d8cb {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:51:45 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8cab1e-9ef0-4095-91ac-6b24f18215b1]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bdc30cfb-9bd2-4cb7-833a-4ff6037555b9 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:45 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb Jul 10 04:51:45 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:46 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bdc30cfb-9bd2-4cb7-833a-4ff6037555b9 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb" returned: 0 in 0.714s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bdc30cfb-9bd2-4cb7-833a-4ff6037555b9 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.2004e45b-c669-4334-9802-16356d22c3a2 2G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:46 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.2004e45b-c669-4334-9802-16356d22c3a2 2G Jul 10 04:51:46 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:47 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bdc30cfb-9bd2-4cb7-833a-4ff6037555b9 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.2004e45b-c669-4334-9802-16356d22c3a2 2G" returned: 0 in 0.752s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bdc30cfb-9bd2-4cb7-833a-4ff6037555b9 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.2004e45b-c669-4334-9802-16356d22c3a2 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:47 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.2004e45b-c669-4334-9802-16356d22c3a2 Jul 10 04:51:47 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:47 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bdc30cfb-9bd2-4cb7-833a-4ff6037555b9 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.2004e45b-c669-4334-9802-16356d22c3a2" returned: 0 in 0.670s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:47 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-bdc30cfb-9bd2-4cb7-833a-4ff6037555b9 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.2004e45b-c669-4334-9802-16356d22c3a2 is being set with open permissions: ugo+rw Jul 10 04:51:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bdc30cfb-9bd2-4cb7-833a-4ff6037555b9 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.2004e45b-c669-4334-9802-16356d22c3a2 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:47 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.2004e45b-c669-4334-9802-16356d22c3a2 Jul 10 04:51:47 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:48 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bdc30cfb-9bd2-4cb7-833a-4ff6037555b9 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.2004e45b-c669-4334-9802-16356d22c3a2" returned: 0 in 0.621s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bdc30cfb-9bd2-4cb7-833a-4ff6037555b9 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:48 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.info Jul 10 04:51:48 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:49 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bdc30cfb-9bd2-4cb7-833a-4ff6037555b9 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.info" returned: 0 in 0.611s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:49 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-bdc30cfb-9bd2-4cb7-833a-4ff6037555b9 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.info is being set with open permissions: ugo+rw Jul 10 04:51:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bdc30cfb-9bd2-4cb7-833a-4ff6037555b9 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:49 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.info Jul 10 04:51:49 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:49 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bdc30cfb-9bd2-4cb7-833a-4ff6037555b9 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.info" returned: 0 in 0.620s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-bdc30cfb-9bd2-4cb7-833a-4ff6037555b9 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.074s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:49 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-bdc30cfb-9bd2-4cb7-833a-4ff6037555b9 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Create snapshot completed successfully Jul 10 04:51:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b1ed4eaf-8a28-49f4-ac39-c035c7993985 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Acquiring lock "cinder-2004e45b-c669-4334-9802-16356d22c3a2-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b1ed4eaf-8a28-49f4-ac39-c035c7993985 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Lock "cinder-2004e45b-c669-4334-9802-16356d22c3a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b1ed4eaf-8a28-49f4-ac39-c035c7993985 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Acquiring lock "cinder-quobyte-3d11fa23-5751-4418-b0a3-afbecec9d8cb" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b1ed4eaf-8a28-49f4-ac39-c035c7993985 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Lock "cinder-quobyte-3d11fa23-5751-4418-b0a3-afbecec9d8cb" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b1ed4eaf-8a28-49f4-ac39-c035c7993985 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Acquiring lock "cinder-quobyte-2004e45b-c669-4334-9802-16356d22c3a2" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b1ed4eaf-8a28-49f4-ac39-c035c7993985 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Lock "cinder-quobyte-2004e45b-c669-4334-9802-16356d22c3a2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-b1ed4eaf-8a28-49f4-ac39-c035c7993985 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Deleting offline snapshot 2004e45b-c669-4334-9802-16356d22c3a2 of volume 3d11fa23-5751-4418-b0a3-afbecec9d8cb {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:51:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-b1ed4eaf-8a28-49f4-ac39-c035c7993985 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] snapshot_file for this snap is: volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.2004e45b-c669-4334-9802-16356d22c3a2 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:51:50 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35bd38a-09ee-4584-8b6b-e72999f0550a]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b1ed4eaf-8a28-49f4-ac39-c035c7993985 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.2004e45b-c669-4334-9802-16356d22c3a2 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:51 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.2004e45b-c669-4334-9802-16356d22c3a2 Jul 10 04:51:51 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:51 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b1ed4eaf-8a28-49f4-ac39-c035c7993985 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.2004e45b-c669-4334-9802-16356d22c3a2" returned: 0 in 0.730s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:51 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-b1ed4eaf-8a28-49f4-ac39-c035c7993985 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:51:51 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb25b6e0-d2bc-4158-8591-f31b0220621d]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b1ed4eaf-8a28-49f4-ac39-c035c7993985 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:51 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb Jul 10 04:51:51 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:52 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b1ed4eaf-8a28-49f4-ac39-c035c7993985 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb" returned: 0 in 0.730s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b1ed4eaf-8a28-49f4-ac39-c035c7993985 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.2004e45b-c669-4334-9802-16356d22c3a2 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:52 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.2004e45b-c669-4334-9802-16356d22c3a2 Jul 10 04:51:52 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:53 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b1ed4eaf-8a28-49f4-ac39-c035c7993985 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.2004e45b-c669-4334-9802-16356d22c3a2" returned: 0 in 0.705s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b1ed4eaf-8a28-49f4-ac39-c035c7993985 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.2004e45b-c669-4334-9802-16356d22c3a2 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:53 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.2004e45b-c669-4334-9802-16356d22c3a2 Jul 10 04:51:53 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:53 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b1ed4eaf-8a28-49f4-ac39-c035c7993985 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb.2004e45b-c669-4334-9802-16356d22c3a2" returned: 0 in 0.623s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b1ed4eaf-8a28-49f4-ac39-c035c7993985 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Lock "cinder-quobyte-2004e45b-c669-4334-9802-16356d22c3a2" released by "_delete_snapshot" :: held 2.885s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b1ed4eaf-8a28-49f4-ac39-c035c7993985 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Lock "cinder-quobyte-3d11fa23-5751-4418-b0a3-afbecec9d8cb" released by "delete_snapshot" :: held 2.906s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:53 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-b1ed4eaf-8a28-49f4-ac39-c035c7993985 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Created reservations ['9781d6f0-3839-444e-8182-4665ff6dde14', '13daa0ba-b4b5-413b-aff8-f7f7d1d84de4', '6024f686-5490-4509-a42e-13c0646192bc', '526653c0-4396-41cd-aa02-24cbc1861661'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:51:53 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-b1ed4eaf-8a28-49f4-ac39-c035c7993985 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Delete snapshot completed successfully. Jul 10 04:51:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b1ed4eaf-8a28-49f4-ac39-c035c7993985 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Lock "cinder-2004e45b-c669-4334-9802-16356d22c3a2-delete_snapshot" released by "delete_snapshot" :: held 3.029s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-23c250bd-1a00-49e3-af91-70905fc1f182 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Acquiring lock "cinder-3d11fa23-5751-4418-b0a3-afbecec9d8cb-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-23c250bd-1a00-49e3-af91-70905fc1f182 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Lock "cinder-3d11fa23-5751-4418-b0a3-afbecec9d8cb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-23c250bd-1a00-49e3-af91-70905fc1f182 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Acquiring lock "cinder-quobyte-3d11fa23-5751-4418-b0a3-afbecec9d8cb" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-23c250bd-1a00-49e3-af91-70905fc1f182 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Lock "cinder-quobyte-3d11fa23-5751-4418-b0a3-afbecec9d8cb" acquired by "delete_volume" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:54 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[009acecd-120b-479f-a928-d696e112b6c5]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-23c250bd-1a00-49e3-af91-70905fc1f182 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:54 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb Jul 10 04:51:54 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:54 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-23c250bd-1a00-49e3-af91-70905fc1f182 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb" returned: 0 in 0.725s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-23c250bd-1a00-49e3-af91-70905fc1f182 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:54 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb Jul 10 04:51:54 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:55 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-23c250bd-1a00-49e3-af91-70905fc1f182 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3d11fa23-5751-4418-b0a3-afbecec9d8cb" returned: 0 in 0.644s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-23c250bd-1a00-49e3-af91-70905fc1f182 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Lock "cinder-quobyte-3d11fa23-5751-4418-b0a3-afbecec9d8cb" released by "delete_volume" :: held 1.423s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:55 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-23c250bd-1a00-49e3-af91-70905fc1f182 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Created reservations ['8d328314-65b7-44c3-a08c-3eaa47707b58', 'a32ef53b-fa7a-463f-a47e-db2bbf530f26', '9cda3a07-692a-475d-a298-33ed81bd8d6e', 'f8df52c1-b052-43bf-9a1b-ad289044888d'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:51:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-23c250bd-1a00-49e3-af91-70905fc1f182 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-23c250bd-1a00-49e3-af91-70905fc1f182 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-23c250bd-1a00-49e3-af91-70905fc1f182 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:51:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-23c250bd-1a00-49e3-af91-70905fc1f182 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:51:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-23c250bd-1a00-49e3-af91-70905fc1f182 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-23c250bd-1a00-49e3-af91-70905fc1f182 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:55 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:51:55 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:56 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-23c250bd-1a00-49e3-af91-70905fc1f182 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.643s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:56 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-23c250bd-1a00-49e3-af91-70905fc1f182 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:51:56 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-23c250bd-1a00-49e3-af91-70905fc1f182 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Deleted volume successfully. Jul 10 04:51:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-23c250bd-1a00-49e3-af91-70905fc1f182 tempest-VolumesSnapshotNegativeTestJSON-563560432 None] Lock "cinder-3d11fa23-5751-4418-b0a3-afbecec9d8cb-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:52:00 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=78,cinder:SELECT=63,cinder:INSERT=25,cinder:DELETE=2 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:52:10 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:DELETE=4,cinder:SELECT=40,cinder:INSERT=12,cinder:UPDATE=44 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:52:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:52:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:52:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:52:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:15 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:52:15 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:16 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.646s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:52:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:52:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:52:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Flow 'volume_create_manager' (672f3442-395b-4be3-b151-fedcaeb749b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e67d819-64e4-40a9-9560-34555275b649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e67d819-64e4-40a9-9560-34555275b649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-438729706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392f0d7a-80a2-476c-aa1c-c7f28fc38f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f67d43084742c1a1eb114f05a962b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:52:20Z,use_quota=True,user_id='b80a791c378b466e83109c50c0e9f33a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a066df9-7ebe-49be-8cc6-b24fc9e69c60),volume_type_id=9a066df9-7ebe-49be-8cc6-b24fc9e69c60)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (032349c1-15e5-464f-8737-c5be81ad9c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (032349c1-15e5-464f-8737-c5be81ad9c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbc4947-f158-4955-a0e6-a090e56a2cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbc4947-f158-4955-a0e6-a090e56a2cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '392f0d7a-80a2-476c-aa1c-c7f28fc38f12', 'volume_name': 'volume-392f0d7a-80a2-476c-aa1c-c7f28fc38f12', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20a8c82-f5d5-41ae-b64a-ab01fb5b7467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20a8c82-f5d5-41ae-b64a-ab01fb5b7467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca6c3d0-4b80-46cf-91b0-83974520421d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:20 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Volume 392f0d7a-80a2-476c-aa1c-c7f28fc38f12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-392f0d7a-80a2-476c-aa1c-c7f28fc38f12', 'volume_size': 1} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-438729706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392f0d7a-80a2-476c-aa1c-c7f28fc38f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f67d43084742c1a1eb114f05a962b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:52:20Z,use_quota=True,user_id='b80a791c378b466e83109c50c0e9f33a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a066df9-7ebe-49be-8cc6-b24fc9e69c60),volume_type_id=9a066df9-7ebe-49be-8cc6-b24fc9e69c60)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Creating volume 392f0d7a-80a2-476c-aa1c-c7f28fc38f12 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:52:20 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392f0d7a-80a2-476c-aa1c-c7f28fc38f12 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:20 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392f0d7a-80a2-476c-aa1c-c7f28fc38f12 1073741824 Jul 10 04:52:20 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Flow 'volume_create_manager' (2aeb93f2-2852-44a2-a2ad-90d688158e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62bdae7a-6d05-47e6-abec-3338ca20c210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62bdae7a-6d05-47e6-abec-3338ca20c210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-492830272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea179c9-95eb-4cc8-9351-878f44fefbff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f67d43084742c1a1eb114f05a962b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:52:21Z,use_quota=True,user_id='b80a791c378b466e83109c50c0e9f33a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7594e938-78ff-42de-ae6e-783a20e6d9a4),volume_type_id=7594e938-78ff-42de-ae6e-783a20e6d9a4)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2310c0-7bf9-475f-ae00-809ec53a29cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2310c0-7bf9-475f-ae00-809ec53a29cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab0983d-24c2-4e9c-b1ec-80088edc3875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab0983d-24c2-4e9c-b1ec-80088edc3875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dea179c9-95eb-4cc8-9351-878f44fefbff', 'volume_name': 'volume-dea179c9-95eb-4cc8-9351-878f44fefbff', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb44ff71-eecc-4dad-b131-6aa631c7fa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb44ff71-eecc-4dad-b131-6aa631c7fa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a7bb9a7-2544-4a6e-a51a-86cc0db1c49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:20 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Volume dea179c9-95eb-4cc8-9351-878f44fefbff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dea179c9-95eb-4cc8-9351-878f44fefbff', 'volume_size': 1} Jul 10 04:52:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:21 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392f0d7a-80a2-476c-aa1c-c7f28fc38f12 1073741824" returned: 0 in 0.897s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:21 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:52:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Flow 'volume_create_manager' (56427091-eb78-4344-ab3e-dd27bd3ace85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:52:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0064d9fc-a1d3-43da-83b4-e24a75ebdd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0064d9fc-a1d3-43da-83b4-e24a75ebdd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-710617889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b698de-8cbd-4bc8-866b-42499f99035d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f67d43084742c1a1eb114f05a962b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:52:21Z,use_quota=True,user_id='b80a791c378b466e83109c50c0e9f33a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53c0559c-9a79-4cb3-92d8-86f224ae0000),volume_type_id=53c0559c-9a79-4cb3-92d8-86f224ae0000)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd91804-59fd-48b3-ab95-6594b6835ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd91804-59fd-48b3-ab95-6594b6835ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9d7c8f-4f8d-4a79-b809-5aa856e1375e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:21 devstack cinder-volume[87359]: DEBUG cinder.image.glance [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Creating Keystone auth plugin from conf {{(pid=87359) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 04:52:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392f0d7a-80a2-476c-aa1c-c7f28fc38f12 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:21 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392f0d7a-80a2-476c-aa1c-c7f28fc38f12 Jul 10 04:52:21 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9d7c8f-4f8d-4a79-b809-5aa856e1375e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a0b698de-8cbd-4bc8-866b-42499f99035d', 'volume_name': 'volume-a0b698de-8cbd-4bc8-866b-42499f99035d', 'volume_size': 1, 'image_id': '43258f79-5eee-4f05-bfd9-3807d35e5654', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43258f79-5eee-4f05-bfd9-3807d35e5654', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1182721256', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b3f67d43084742c1a1eb114f05a962b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43258f79-5eee-4f05-bfd9-3807d35e5654', 'created_at': datetime.datetime(2026, 7, 10, 2, 52, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 52, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43258f79-5eee-4f05-bfd9-3807d35e5654/file', 'properties': {}}, 'image_service': }' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ae4a7f-3616-4d7f-afe1-8513747618bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ae4a7f-3616-4d7f-afe1-8513747618bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17974e1-0e98-46f8-9aba-5374613b4270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:21 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Volume a0b698de-8cbd-4bc8-866b-42499f99035d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a0b698de-8cbd-4bc8-866b-42499f99035d', 'volume_size': 1, 'image_id': '43258f79-5eee-4f05-bfd9-3807d35e5654', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43258f79-5eee-4f05-bfd9-3807d35e5654', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1182721256', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b3f67d43084742c1a1eb114f05a962b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43258f79-5eee-4f05-bfd9-3807d35e5654', 'created_at': datetime.datetime(2026, 7, 10, 2, 52, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 52, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43258f79-5eee-4f05-bfd9-3807d35e5654/file', 'properties': {}}, 'image_service': } Jul 10 04:52:21 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Trying to clone a0b698de-8cbd-4bc8-866b-42499f99035d from image 43258f79-5eee-4f05-bfd9-3807d35e5654 at location (None, [{'url': 'file:///opt/stack/data/glance/images/43258f79-5eee-4f05-bfd9-3807d35e5654', 'metadata': {}}]). {{(pid=87359) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 04:52:22 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392f0d7a-80a2-476c-aa1c-c7f28fc38f12" returned: 0 in 0.657s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:52:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.318s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-492830272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea179c9-95eb-4cc8-9351-878f44fefbff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f67d43084742c1a1eb114f05a962b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:52:21Z,use_quota=True,user_id='b80a791c378b466e83109c50c0e9f33a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7594e938-78ff-42de-ae6e-783a20e6d9a4),volume_type_id=7594e938-78ff-42de-ae6e-783a20e6d9a4)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:52:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Creating volume dea179c9-95eb-4cc8-9351-878f44fefbff {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:52:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:52:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:52:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:52:22 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:52:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dea179c9-95eb-4cc8-9351-878f44fefbff 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:22 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dea179c9-95eb-4cc8-9351-878f44fefbff 1073741824 Jul 10 04:52:22 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca6c3d0-4b80-46cf-91b0-83974520421d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-392f0d7a-80a2-476c-aa1c-c7f28fc38f12', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22186cd9-85a1-4ce3-b7ca-60bab116bbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:22 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Volume volume-392f0d7a-80a2-476c-aa1c-c7f28fc38f12 (392f0d7a-80a2-476c-aa1c-c7f28fc38f12): created successfully Jul 10 04:52:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22186cd9-85a1-4ce3-b7ca-60bab116bbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Flow 'volume_create_manager' (672f3442-395b-4be3-b151-fedcaeb749b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:52:22 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-8dbb1af0-9f64-4d12-8223-04bdc1c752aa tempest-TestInstancesWithCinderVolumes-876483242 None] Created volume successfully. Jul 10 04:52:22 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dea179c9-95eb-4cc8-9351-878f44fefbff 1073741824" returned: 0 in 0.785s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dea179c9-95eb-4cc8-9351-878f44fefbff {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:23 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dea179c9-95eb-4cc8-9351-878f44fefbff Jul 10 04:52:23 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:23 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dea179c9-95eb-4cc8-9351-878f44fefbff" returned: 0 in 0.636s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:23 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:52:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:23 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a7bb9a7-2544-4a6e-a51a-86cc0db1c49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dea179c9-95eb-4cc8-9351-878f44fefbff', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:23 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15256ac3-9d9a-4456-ab5a-8272ea837324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:23 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Volume volume-dea179c9-95eb-4cc8-9351-878f44fefbff (dea179c9-95eb-4cc8-9351-878f44fefbff): created successfully Jul 10 04:52:23 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15256ac3-9d9a-4456-ab5a-8272ea837324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:23 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Flow 'volume_create_manager' (2aeb93f2-2852-44a2-a2ad-90d688158e8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:52:23 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ee877132-c225-447e-862a-d355acb72a6f tempest-TestInstancesWithCinderVolumes-876483242 None] Created volume successfully. Jul 10 04:52:24 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_43258f79-5eee-4f05-bfd9-3807d35e5654_m7w8ue3jdevstack@QuobyteHD, size 20.69 MB, duration 2.92 sec {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Jul 10 04:52:24 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Image download 20.69 MB at 7.07 MB/s Jul 10 04:52:24 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[786953fd-e8b3-415d-a64a-1744261b990f]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:52:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43258f79-5eee-4f05-bfd9-3807d35e5654_m7w8ue3jdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:24 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43258f79-5eee-4f05-bfd9-3807d35e5654_m7w8ue3jdevstack@QuobyteHD Jul 10 04:52:24 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:25 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43258f79-5eee-4f05-bfd9-3807d35e5654_m7w8ue3jdevstack@QuobyteHD" returned: 0 in 0.700s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:25 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Temporary image 43258f79-5eee-4f05-bfd9-3807d35e5654 is fetched for user b80a791c378b466e83109c50c0e9f33a. {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Jul 10 04:52:25 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b2432d-6d65-42a7-a396-3fb115775c34]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:52:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43258f79-5eee-4f05-bfd9-3807d35e5654_m7w8ue3jdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:25 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43258f79-5eee-4f05-bfd9-3807d35e5654_m7w8ue3jdevstack@QuobyteHD Jul 10 04:52:25 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:26 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43258f79-5eee-4f05-bfd9-3807d35e5654_m7w8ue3jdevstack@QuobyteHD" returned: 0 in 0.741s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-710617889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b698de-8cbd-4bc8-866b-42499f99035d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f67d43084742c1a1eb114f05a962b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:52:21Z,use_quota=True,user_id='b80a791c378b466e83109c50c0e9f33a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53c0559c-9a79-4cb3-92d8-86f224ae0000),volume_type_id=53c0559c-9a79-4cb3-92d8-86f224ae0000)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:52:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Creating volume a0b698de-8cbd-4bc8-866b-42499f99035d {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:52:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:52:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:52:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:52:26 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:52:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:26 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d 1073741824 Jul 10 04:52:26 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:27 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d 1073741824" returned: 0 in 0.785s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:27 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d Jul 10 04:52:27 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:27 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d" returned: 0 in 0.635s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:52:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:27 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Attempting download of 43258f79-5eee-4f05-bfd9-3807d35e5654 ((None, [{'url': 'file:///opt/stack/data/glance/images/43258f79-5eee-4f05-bfd9-3807d35e5654', 'metadata': {}}])) to volume a0b698de-8cbd-4bc8-866b-42499f99035d. {{(pid=87359) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 04:52:27 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[6528b3ca-d811-4174-aec4-a4e0bf69cce7]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:52:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43258f79-5eee-4f05-bfd9-3807d35e5654_y6m_w6lp {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:27 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43258f79-5eee-4f05-bfd9-3807d35e5654_y6m_w6lp Jul 10 04:52:27 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:28 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43258f79-5eee-4f05-bfd9-3807d35e5654_y6m_w6lp" returned: 0 in 0.709s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43258f79-5eee-4f05-bfd9-3807d35e5654_y6m_w6lp {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:28 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43258f79-5eee-4f05-bfd9-3807d35e5654_y6m_w6lp Jul 10 04:52:28 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:29 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43258f79-5eee-4f05-bfd9-3807d35e5654_y6m_w6lp" returned: 1 in 0.702s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43258f79-5eee-4f05-bfd9-3807d35e5654_y6m_w6lp' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:52:29 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3bbda1-38fd-4bba-b291-d84b8e777107]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:52:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43258f79-5eee-4f05-bfd9-3807d35e5654_m7w8ue3jdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:29 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43258f79-5eee-4f05-bfd9-3807d35e5654_m7w8ue3jdevstack@QuobyteHD Jul 10 04:52:29 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:29 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43258f79-5eee-4f05-bfd9-3807d35e5654_m7w8ue3jdevstack@QuobyteHD" returned: 0 in 0.702s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:29 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] 43258f79-5eee-4f05-bfd9-3807d35e5654 was qcow2, converting to raw {{(pid=87359) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Jul 10 04:52:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43258f79-5eee-4f05-bfd9-3807d35e5654_m7w8ue3jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:29 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43258f79-5eee-4f05-bfd9-3807d35e5654_m7w8ue3jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d Jul 10 04:52:29 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:31 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43258f79-5eee-4f05-bfd9-3807d35e5654_m7w8ue3jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d" returned: 0 in 1.784s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:31 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_43258f79-5eee-4f05-bfd9-3807d35e5654_m7w8ue3jdevstack@QuobyteHD, size 112.00 MB, duration 1.79 sec, destination /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:52:31 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Converted 112.00 MB image at 62.73 MB/s Jul 10 04:52:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:31 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d 1G Jul 10 04:52:31 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:32 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d 1G" returned: 0 in 0.646s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:32 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[8520d274-7e31-487c-a684-45f202dd52a8]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:52:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:32 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d Jul 10 04:52:32 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:33 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d" returned: 0 in 0.746s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:33 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d Jul 10 04:52:33 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:33 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d" returned: 1 in 0.768s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:52:33 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Downloaded image 43258f79-5eee-4f05-bfd9-3807d35e5654 ((None, [{'url': 'file:///opt/stack/data/glance/images/43258f79-5eee-4f05-bfd9-3807d35e5654', 'metadata': {}}])) to volume a0b698de-8cbd-4bc8-866b-42499f99035d successfully. {{(pid=87359) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 04:52:33 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Temporary image 43258f79-5eee-4f05-bfd9-3807d35e5654 for user b80a791c378b466e83109c50c0e9f33a is deleted. {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Jul 10 04:52:33 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Marking volume a0b698de-8cbd-4bc8-866b-42499f99035d as bootable. {{(pid=87359) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 04:52:33 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Copying metadata from image 43258f79-5eee-4f05-bfd9-3807d35e5654 to a0b698de-8cbd-4bc8-866b-42499f99035d. {{(pid=87359) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 04:52:33 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Creating volume glance metadata for volume a0b698de-8cbd-4bc8-866b-42499f99035d backed by image 43258f79-5eee-4f05-bfd9-3807d35e5654 with: {'image_id': '43258f79-5eee-4f05-bfd9-3807d35e5654', 'image_name': 'tempest-scenario-img--1182721256', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87359) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 04:52:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17974e1-0e98-46f8-9aba-5374613b4270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0b698de-8cbd-4bc8-866b-42499f99035d', 'volume_size': 1, 'image_id': '43258f79-5eee-4f05-bfd9-3807d35e5654', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43258f79-5eee-4f05-bfd9-3807d35e5654', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1182721256', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b3f67d43084742c1a1eb114f05a962b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43258f79-5eee-4f05-bfd9-3807d35e5654', 'created_at': datetime.datetime(2026, 7, 10, 2, 52, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 52, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43258f79-5eee-4f05-bfd9-3807d35e5654/file', 'properties': {}}, 'image_service': }' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e569696d-2e51-4882-b885-0654ffc92746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:33 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Volume volume-a0b698de-8cbd-4bc8-866b-42499f99035d (a0b698de-8cbd-4bc8-866b-42499f99035d): created successfully Jul 10 04:52:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e569696d-2e51-4882-b885-0654ffc92746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Flow 'volume_create_manager' (56427091-eb78-4344-ab3e-dd27bd3ace85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:52:33 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-bc9b7a23-a479-4fda-bced-7ff20ac34518 tempest-TestInstancesWithCinderVolumes-876483242 None] Created volume successfully. Jul 10 04:52:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-a41dc351-409d-47f3-af49-d972da2c2c94 req-03afc644-bda2-4878-9440-ab4f2d379d2a tempest-TestInstancesWithCinderVolumes-876483242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-a41dc351-409d-47f3-af49-d972da2c2c94 req-03afc644-bda2-4878-9440-ab4f2d379d2a tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:41 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02e0593-cb47-4f98-8d6f-f81d627416aa]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:52:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-a41dc351-409d-47f3-af49-d972da2c2c94 req-03afc644-bda2-4878-9440-ab4f2d379d2a tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:41 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d Jul 10 04:52:41 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:42 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-a41dc351-409d-47f3-af49-d972da2c2c94 req-03afc644-bda2-4878-9440-ab4f2d379d2a tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d" returned: 0 in 0.737s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-a41dc351-409d-47f3-af49-d972da2c2c94 req-03afc644-bda2-4878-9440-ab4f2d379d2a tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:42 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d Jul 10 04:52:42 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:42 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-a41dc351-409d-47f3-af49-d972da2c2c94 req-03afc644-bda2-4878-9440-ab4f2d379d2a tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d" returned: 1 in 0.758s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-a41dc351-409d-47f3-af49-d972da2c2c94 req-03afc644-bda2-4878-9440-ab4f2d379d2a tempest-TestInstancesWithCinderVolumes-876483242 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:52:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-a41dc351-409d-47f3-af49-d972da2c2c94 req-03afc644-bda2-4878-9440-ab4f2d379d2a tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.537s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-a41dc351-409d-47f3-af49-d972da2c2c94 req-03afc644-bda2-4878-9440-ab4f2d379d2a tempest-TestInstancesWithCinderVolumes-876483242 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31', 'name': 'volume-a0b698de-8cbd-4bc8-866b-42499f99035d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '103e7dec-e60d-477a-986b-91992f9216a3', 'enforce_multipath': True} {{(pid=87359) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4975}} Jul 10 04:52:42 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-a41dc351-409d-47f3-af49-d972da2c2c94 req-03afc644-bda2-4878-9440-ab4f2d379d2a tempest-TestInstancesWithCinderVolumes-876483242 None] attachment_update completed successfully. Jul 10 04:52:52 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=17,cinder:UPDATE=10,cinder:DELETE=2,cinder:INSERT=7 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:52:52 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=14,cinder:SELECT=17,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:53:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:53:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:15 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:53:15 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:16 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.647s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:53:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:53:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:53:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:53:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-281cd94c-8718-4439-a3d0-226a9b872ee2 req-b8061367-a679-4174-8b78-40810ab2d341 tempest-TestInstancesWithCinderVolumes-876483242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-281cd94c-8718-4439-a3d0-226a9b872ee2 req-b8061367-a679-4174-8b78-40810ab2d341 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:19 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[11662de9-08b1-4d86-acf3-ff38dfc54506]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-281cd94c-8718-4439-a3d0-226a9b872ee2 req-b8061367-a679-4174-8b78-40810ab2d341 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392f0d7a-80a2-476c-aa1c-c7f28fc38f12 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:19 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392f0d7a-80a2-476c-aa1c-c7f28fc38f12 Jul 10 04:53:19 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:20 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-281cd94c-8718-4439-a3d0-226a9b872ee2 req-b8061367-a679-4174-8b78-40810ab2d341 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392f0d7a-80a2-476c-aa1c-c7f28fc38f12" returned: 0 in 0.723s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-281cd94c-8718-4439-a3d0-226a9b872ee2 req-b8061367-a679-4174-8b78-40810ab2d341 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.739s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-281cd94c-8718-4439-a3d0-226a9b872ee2 req-b8061367-a679-4174-8b78-40810ab2d341 tempest-TestInstancesWithCinderVolumes-876483242 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31', 'name': 'volume-392f0d7a-80a2-476c-aa1c-c7f28fc38f12', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b31910b-469b-4ac9-9ced-421f9162bfb6', 'enforce_multipath': True} {{(pid=87359) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4975}} Jul 10 04:53:20 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-281cd94c-8718-4439-a3d0-226a9b872ee2 req-b8061367-a679-4174-8b78-40810ab2d341 tempest-TestInstancesWithCinderVolumes-876483242 None] attachment_update completed successfully. Jul 10 04:53:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-c5c04a8f-2874-4aca-b87f-4f796556d154 req-2628f4ee-4dbd-47c8-bc05-71c989be91e8 tempest-TestInstancesWithCinderVolumes-876483242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-c5c04a8f-2874-4aca-b87f-4f796556d154 req-2628f4ee-4dbd-47c8-bc05-71c989be91e8 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:27 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5faacc-10b5-4e00-b8ad-8d4252572c44]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-c5c04a8f-2874-4aca-b87f-4f796556d154 req-2628f4ee-4dbd-47c8-bc05-71c989be91e8 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dea179c9-95eb-4cc8-9351-878f44fefbff {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:27 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dea179c9-95eb-4cc8-9351-878f44fefbff Jul 10 04:53:27 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:28 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-c5c04a8f-2874-4aca-b87f-4f796556d154 req-2628f4ee-4dbd-47c8-bc05-71c989be91e8 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dea179c9-95eb-4cc8-9351-878f44fefbff" returned: 0 in 0.779s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-c5c04a8f-2874-4aca-b87f-4f796556d154 req-2628f4ee-4dbd-47c8-bc05-71c989be91e8 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.796s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-c5c04a8f-2874-4aca-b87f-4f796556d154 req-2628f4ee-4dbd-47c8-bc05-71c989be91e8 tempest-TestInstancesWithCinderVolumes-876483242 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31', 'name': 'volume-dea179c9-95eb-4cc8-9351-878f44fefbff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5bbca787-9623-495f-86aa-c69b13dc1be6', 'enforce_multipath': True} {{(pid=87359) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4975}} Jul 10 04:53:28 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-c5c04a8f-2874-4aca-b87f-4f796556d154 req-2628f4ee-4dbd-47c8-bc05-71c989be91e8 tempest-TestInstancesWithCinderVolumes-876483242 None] attachment_update completed successfully. Jul 10 04:53:37 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-117b4d65-68a0-443a-b832-84e818ccce42 req-044a6eea-da50-427f-9d63-045069a9103a tempest-TestInstancesWithCinderVolumes-876483242 None] Terminate volume connection completed successfully. Jul 10 04:53:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-117b4d65-68a0-443a-b832-84e818ccce42 req-044a6eea-da50-427f-9d63-045069a9103a tempest-TestInstancesWithCinderVolumes-876483242 None] Deleting attachment 5b31910b-469b-4ac9-9ced-421f9162bfb6. {{(pid=87359) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5106}} Jul 10 04:53:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-163168d4-19d8-4a92-b0c9-d2c9175e41b2 tempest-TestInstancesWithCinderVolumes-876483242 None] Acquiring lock "cinder-392f0d7a-80a2-476c-aa1c-c7f28fc38f12-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-163168d4-19d8-4a92-b0c9-d2c9175e41b2 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "cinder-392f0d7a-80a2-476c-aa1c-c7f28fc38f12-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-163168d4-19d8-4a92-b0c9-d2c9175e41b2 tempest-TestInstancesWithCinderVolumes-876483242 None] Acquiring lock "cinder-quobyte-392f0d7a-80a2-476c-aa1c-c7f28fc38f12" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-163168d4-19d8-4a92-b0c9-d2c9175e41b2 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "cinder-quobyte-392f0d7a-80a2-476c-aa1c-c7f28fc38f12" acquired by "delete_volume" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:39 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa40790f-91d5-4091-abf8-424e04f71b53]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-163168d4-19d8-4a92-b0c9-d2c9175e41b2 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392f0d7a-80a2-476c-aa1c-c7f28fc38f12 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:39 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392f0d7a-80a2-476c-aa1c-c7f28fc38f12 Jul 10 04:53:39 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:39 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-163168d4-19d8-4a92-b0c9-d2c9175e41b2 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392f0d7a-80a2-476c-aa1c-c7f28fc38f12" returned: 0 in 0.828s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-163168d4-19d8-4a92-b0c9-d2c9175e41b2 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392f0d7a-80a2-476c-aa1c-c7f28fc38f12 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:39 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392f0d7a-80a2-476c-aa1c-c7f28fc38f12 Jul 10 04:53:39 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:40 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-163168d4-19d8-4a92-b0c9-d2c9175e41b2 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-392f0d7a-80a2-476c-aa1c-c7f28fc38f12" returned: 0 in 0.704s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:40 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-163168d4-19d8-4a92-b0c9-d2c9175e41b2 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "cinder-quobyte-392f0d7a-80a2-476c-aa1c-c7f28fc38f12" released by "delete_volume" :: held 1.575s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:40 devstack cinder-volume[87359]: WARNING cinder.quota [None req-163168d4-19d8-4a92-b0c9-d2c9175e41b2 tempest-TestInstancesWithCinderVolumes-876483242 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2103920306-254475302 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2103920306-254475302, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:53:40 devstack cinder-volume[87359]: WARNING cinder.quota [None req-163168d4-19d8-4a92-b0c9-d2c9175e41b2 tempest-TestInstancesWithCinderVolumes-876483242 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2103920306-254475302 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2103920306-254475302, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:53:40 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-163168d4-19d8-4a92-b0c9-d2c9175e41b2 tempest-TestInstancesWithCinderVolumes-876483242 None] Created reservations ['e8240408-9662-4240-9a6b-ab02ed378e08', 'ac12375e-a05f-46f6-8b2e-7918241391d2', 'a96027d4-dd73-4a64-8b5d-2ea3cbd4059c', 'cf9caa34-c480-4a3d-96e8-6cc16b305e8d'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:53:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-163168d4-19d8-4a92-b0c9-d2c9175e41b2 tempest-TestInstancesWithCinderVolumes-876483242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-163168d4-19d8-4a92-b0c9-d2c9175e41b2 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-163168d4-19d8-4a92-b0c9-d2c9175e41b2 tempest-TestInstancesWithCinderVolumes-876483242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-163168d4-19d8-4a92-b0c9-d2c9175e41b2 tempest-TestInstancesWithCinderVolumes-876483242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-163168d4-19d8-4a92-b0c9-d2c9175e41b2 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-163168d4-19d8-4a92-b0c9-d2c9175e41b2 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:40 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:53:40 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:41 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-163168d4-19d8-4a92-b0c9-d2c9175e41b2 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.643s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:41 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-163168d4-19d8-4a92-b0c9-d2c9175e41b2 tempest-TestInstancesWithCinderVolumes-876483242 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:53:41 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-163168d4-19d8-4a92-b0c9-d2c9175e41b2 tempest-TestInstancesWithCinderVolumes-876483242 None] Deleted volume successfully. Jul 10 04:53:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-163168d4-19d8-4a92-b0c9-d2c9175e41b2 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "cinder-392f0d7a-80a2-476c-aa1c-c7f28fc38f12-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:43 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-8753d747-d31a-4260-a570-b19a460bcc66 req-797f1b91-b349-41f8-b818-a249bc41d7cd tempest-TestInstancesWithCinderVolumes-876483242 None] Terminate volume connection completed successfully. Jul 10 04:53:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-8753d747-d31a-4260-a570-b19a460bcc66 req-797f1b91-b349-41f8-b818-a249bc41d7cd tempest-TestInstancesWithCinderVolumes-876483242 None] Deleting attachment 5bbca787-9623-495f-86aa-c69b13dc1be6. {{(pid=87359) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5106}} Jul 10 04:53:45 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-27b81fd0-ed81-4370-b424-197cceb2f4d3 tempest-TestInstancesWithCinderVolumes-876483242 None] Acquiring lock "cinder-dea179c9-95eb-4cc8-9351-878f44fefbff-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:45 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-27b81fd0-ed81-4370-b424-197cceb2f4d3 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "cinder-dea179c9-95eb-4cc8-9351-878f44fefbff-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:45 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-27b81fd0-ed81-4370-b424-197cceb2f4d3 tempest-TestInstancesWithCinderVolumes-876483242 None] Acquiring lock "cinder-quobyte-dea179c9-95eb-4cc8-9351-878f44fefbff" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:45 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-27b81fd0-ed81-4370-b424-197cceb2f4d3 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "cinder-quobyte-dea179c9-95eb-4cc8-9351-878f44fefbff" acquired by "delete_volume" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:45 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9f0b1d-96c0-4974-a22f-d753246bb118]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-27b81fd0-ed81-4370-b424-197cceb2f4d3 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dea179c9-95eb-4cc8-9351-878f44fefbff {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:45 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dea179c9-95eb-4cc8-9351-878f44fefbff Jul 10 04:53:45 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:46 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-27b81fd0-ed81-4370-b424-197cceb2f4d3 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dea179c9-95eb-4cc8-9351-878f44fefbff" returned: 0 in 0.807s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-27b81fd0-ed81-4370-b424-197cceb2f4d3 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dea179c9-95eb-4cc8-9351-878f44fefbff {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:46 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dea179c9-95eb-4cc8-9351-878f44fefbff Jul 10 04:53:46 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:46 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-27b81fd0-ed81-4370-b424-197cceb2f4d3 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dea179c9-95eb-4cc8-9351-878f44fefbff" returned: 0 in 0.662s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:46 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-27b81fd0-ed81-4370-b424-197cceb2f4d3 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "cinder-quobyte-dea179c9-95eb-4cc8-9351-878f44fefbff" released by "delete_volume" :: held 1.514s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:46 devstack cinder-volume[87359]: WARNING cinder.quota [None req-27b81fd0-ed81-4370-b424-197cceb2f4d3 tempest-TestInstancesWithCinderVolumes-876483242 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2146156292-303415467 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2146156292-303415467, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:53:46 devstack cinder-volume[87359]: WARNING cinder.quota [None req-27b81fd0-ed81-4370-b424-197cceb2f4d3 tempest-TestInstancesWithCinderVolumes-876483242 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2146156292-303415467 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2146156292-303415467, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:53:46 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-27b81fd0-ed81-4370-b424-197cceb2f4d3 tempest-TestInstancesWithCinderVolumes-876483242 None] Created reservations ['19c43664-f822-4212-be4b-71a77cd3c004', '9b6631fc-e284-427f-93b2-e421ca3d070d', 'a1ed7047-7334-4a8d-9b00-00424b921546', '4dc0f744-5ea5-411e-b012-df15737bdedc'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:53:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-27b81fd0-ed81-4370-b424-197cceb2f4d3 tempest-TestInstancesWithCinderVolumes-876483242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-27b81fd0-ed81-4370-b424-197cceb2f4d3 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-27b81fd0-ed81-4370-b424-197cceb2f4d3 tempest-TestInstancesWithCinderVolumes-876483242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-27b81fd0-ed81-4370-b424-197cceb2f4d3 tempest-TestInstancesWithCinderVolumes-876483242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-27b81fd0-ed81-4370-b424-197cceb2f4d3 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-27b81fd0-ed81-4370-b424-197cceb2f4d3 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:46 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:53:46 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:47 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-27b81fd0-ed81-4370-b424-197cceb2f4d3 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.703s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:47 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-27b81fd0-ed81-4370-b424-197cceb2f4d3 tempest-TestInstancesWithCinderVolumes-876483242 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:53:47 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-27b81fd0-ed81-4370-b424-197cceb2f4d3 tempest-TestInstancesWithCinderVolumes-876483242 None] Deleted volume successfully. Jul 10 04:53:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-27b81fd0-ed81-4370-b424-197cceb2f4d3 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "cinder-dea179c9-95eb-4cc8-9351-878f44fefbff-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:51 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-e45c0ed1-5c02-4939-a1f9-1694780ade38 req-1e84f36a-3e65-43b0-b0fc-0507a738cf26 tempest-TestInstancesWithCinderVolumes-876483242 None] Terminate volume connection completed successfully. Jul 10 04:53:51 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-e45c0ed1-5c02-4939-a1f9-1694780ade38 req-1e84f36a-3e65-43b0-b0fc-0507a738cf26 tempest-TestInstancesWithCinderVolumes-876483242 None] Deleting attachment 103e7dec-e60d-477a-986b-91992f9216a3. {{(pid=87359) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5106}} Jul 10 04:53:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] Acquiring lock "cinder-a0b698de-8cbd-4bc8-866b-42499f99035d-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "cinder-a0b698de-8cbd-4bc8-866b-42499f99035d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] Acquiring lock "cinder-quobyte-a0b698de-8cbd-4bc8-866b-42499f99035d" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "cinder-quobyte-a0b698de-8cbd-4bc8-866b-42499f99035d" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:54 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[16eed45b-7fcc-4be9-86c7-553a4069acc9]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:54 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d Jul 10 04:53:54 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:55 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d" returned: 0 in 0.760s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:55 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d Jul 10 04:53:55 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:56 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d" returned: 1 in 0.731s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:53:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:56 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d Jul 10 04:53:56 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:56 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a0b698de-8cbd-4bc8-866b-42499f99035d" returned: 0 in 0.611s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "cinder-quobyte-a0b698de-8cbd-4bc8-866b-42499f99035d" released by "delete_volume" :: held 2.159s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:56 devstack cinder-volume[87359]: WARNING cinder.quota [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1056844217-2030876947 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1056844217-2030876947, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:53:56 devstack cinder-volume[87359]: WARNING cinder.quota [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1056844217-2030876947 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1056844217-2030876947, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:53:56 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] Created reservations ['d7bba7f6-84e8-47db-b119-58132568ba11', 'cec1858b-9aad-4e4f-90b0-56aae84c3165', '3d1ddf26-27d7-40a5-80eb-445f00b8af75', 'efa8508c-c50d-454e-bf3e-72fb0873b537'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:53:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:56 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:53:56 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:57 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.613s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:57 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:53:57 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] Deleted volume successfully. Jul 10 04:53:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c1b14ed-317b-45ea-ac25-2a5455dda563 tempest-TestInstancesWithCinderVolumes-876483242 None] Lock "cinder-a0b698de-8cbd-4bc8-866b-42499f99035d-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:10 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=30,cinder:UPDATE=25,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:54:10 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=29,cinder:UPDATE=30,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:54:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:54:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:15 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:54:15 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:16 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.724s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:54:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:54:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:54:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:54:25 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:54:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Flow 'volume_create_manager' (05b16344-08d3-416e-9c5d-f4b8298111ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:54:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa68aaf8-65e9-4e06-b956-1b0b284efa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa68aaf8-65e9-4e06-b956-1b0b284efa2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1765588224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02147d50-ef1c-4bd8-bbe0-413731d877fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25c05555862f4e04b7d3b24d2128051b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:54:26Z,use_quota=True,user_id='4cab94d6b0ec45a38a065ed9742dbd8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b86da53-d53c-494d-88c9-479dec9ace9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b86da53-d53c-494d-88c9-479dec9ace9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1662062c-4048-4d65-a39a-6db64399525b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1662062c-4048-4d65-a39a-6db64399525b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02147d50-ef1c-4bd8-bbe0-413731d877fc', 'volume_name': 'volume-02147d50-ef1c-4bd8-bbe0-413731d877fc', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415d1b4e-16e6-4237-a5f5-170acebb62a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415d1b4e-16e6-4237-a5f5-170acebb62a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4075328-a94f-4878-8939-a7da737ea758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:25 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Volume 02147d50-ef1c-4bd8-bbe0-413731d877fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02147d50-ef1c-4bd8-bbe0-413731d877fc', 'volume_size': 1} Jul 10 04:54:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1765588224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02147d50-ef1c-4bd8-bbe0-413731d877fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25c05555862f4e04b7d3b24d2128051b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:54:26Z,use_quota=True,user_id='4cab94d6b0ec45a38a065ed9742dbd8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:54:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Creating volume 02147d50-ef1c-4bd8-bbe0-413731d877fc {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:54:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:54:25 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:54:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-02147d50-ef1c-4bd8-bbe0-413731d877fc 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:25 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-02147d50-ef1c-4bd8-bbe0-413731d877fc 1073741824 Jul 10 04:54:25 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:26 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:54:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Flow 'volume_create_manager' (6d1082f1-3613-4b47-ac4e-296ac42629b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:54:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a395f2-bf54-4484-a9e9-bf5e087df7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a395f2-bf54-4484-a9e9-bf5e087df7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-218230473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36ed659-cdba-4928-9f21-67ffa12eaa06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25c05555862f4e04b7d3b24d2128051b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:54:26Z,use_quota=True,user_id='4cab94d6b0ec45a38a065ed9742dbd8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9759bd9-b2e1-4408-aea7-1d7124c70799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9759bd9-b2e1-4408-aea7-1d7124c70799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8194ca9b-fb6c-4860-ba19-47a5115b9cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8194ca9b-fb6c-4860-ba19-47a5115b9cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f36ed659-cdba-4928-9f21-67ffa12eaa06', 'volume_name': 'volume-f36ed659-cdba-4928-9f21-67ffa12eaa06', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b993502-4b5f-444f-8ffc-5289abfcf143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b993502-4b5f-444f-8ffc-5289abfcf143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c2c7c4f-021a-450f-934b-c430d9b904b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:26 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Volume f36ed659-cdba-4928-9f21-67ffa12eaa06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f36ed659-cdba-4928-9f21-67ffa12eaa06', 'volume_size': 1} Jul 10 04:54:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:26 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-02147d50-ef1c-4bd8-bbe0-413731d877fc 1073741824" returned: 0 in 0.969s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-02147d50-ef1c-4bd8-bbe0-413731d877fc {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:26 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-02147d50-ef1c-4bd8-bbe0-413731d877fc Jul 10 04:54:26 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:27 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-02147d50-ef1c-4bd8-bbe0-413731d877fc" returned: 0 in 0.663s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:54:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.306s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-218230473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36ed659-cdba-4928-9f21-67ffa12eaa06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25c05555862f4e04b7d3b24d2128051b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:54:26Z,use_quota=True,user_id='4cab94d6b0ec45a38a065ed9742dbd8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:54:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Creating volume f36ed659-cdba-4928-9f21-67ffa12eaa06 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:54:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:54:27 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:54:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f36ed659-cdba-4928-9f21-67ffa12eaa06 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4075328-a94f-4878-8939-a7da737ea758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02147d50-ef1c-4bd8-bbe0-413731d877fc', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:27 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f36ed659-cdba-4928-9f21-67ffa12eaa06 1073741824 Jul 10 04:54:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d371fa3a-2015-489c-9905-1b284fbbe1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:27 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:27 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Volume volume-02147d50-ef1c-4bd8-bbe0-413731d877fc (02147d50-ef1c-4bd8-bbe0-413731d877fc): created successfully Jul 10 04:54:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d371fa3a-2015-489c-9905-1b284fbbe1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Flow 'volume_create_manager' (05b16344-08d3-416e-9c5d-f4b8298111ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:54:27 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-48b00525-aac3-478b-a239-e610d25d3105 tempest-TestServerVolumeAttachmentScenario-230733730 None] Created volume successfully. Jul 10 04:54:28 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f36ed659-cdba-4928-9f21-67ffa12eaa06 1073741824" returned: 0 in 0.838s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f36ed659-cdba-4928-9f21-67ffa12eaa06 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:28 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f36ed659-cdba-4928-9f21-67ffa12eaa06 Jul 10 04:54:28 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:28 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f36ed659-cdba-4928-9f21-67ffa12eaa06" returned: 0 in 0.641s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:54:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c2c7c4f-021a-450f-934b-c430d9b904b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f36ed659-cdba-4928-9f21-67ffa12eaa06', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e14798a-a405-45f6-a4a4-5ef1a71fc3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:28 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Volume volume-f36ed659-cdba-4928-9f21-67ffa12eaa06 (f36ed659-cdba-4928-9f21-67ffa12eaa06): created successfully Jul 10 04:54:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e14798a-a405-45f6-a4a4-5ef1a71fc3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Flow 'volume_create_manager' (6d1082f1-3613-4b47-ac4e-296ac42629b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:54:29 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-6a89ae67-2f96-4f94-9953-b4823dfae9f4 tempest-TestServerVolumeAttachmentScenario-230733730 None] Created volume successfully. Jul 10 04:54:39 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=6,cinder:SELECT=3,cinder:INSERT=2 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:54:39 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=5,cinder:UPDATE=6,cinder:DELETE=2 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:55:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-50bf22b1-0f86-4c84-a797-1f70aa28db42 req-b5c3fec9-499a-4136-8018-d2807a24ef45 tempest-TestServerVolumeAttachmentScenario-230733730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-50bf22b1-0f86-4c84-a797-1f70aa28db42 req-b5c3fec9-499a-4136-8018-d2807a24ef45 tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:07 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfd7a4c-e688-4c4f-aee0-afc4c46b4eb6]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-50bf22b1-0f86-4c84-a797-1f70aa28db42 req-b5c3fec9-499a-4136-8018-d2807a24ef45 tempest-TestServerVolumeAttachmentScenario-230733730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-02147d50-ef1c-4bd8-bbe0-413731d877fc {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:07 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-02147d50-ef1c-4bd8-bbe0-413731d877fc Jul 10 04:55:07 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:08 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-50bf22b1-0f86-4c84-a797-1f70aa28db42 req-b5c3fec9-499a-4136-8018-d2807a24ef45 tempest-TestServerVolumeAttachmentScenario-230733730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-02147d50-ef1c-4bd8-bbe0-413731d877fc" returned: 0 in 0.796s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-50bf22b1-0f86-4c84-a797-1f70aa28db42 req-b5c3fec9-499a-4136-8018-d2807a24ef45 tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.813s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-50bf22b1-0f86-4c84-a797-1f70aa28db42 req-b5c3fec9-499a-4136-8018-d2807a24ef45 tempest-TestServerVolumeAttachmentScenario-230733730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31', 'name': 'volume-02147d50-ef1c-4bd8-bbe0-413731d877fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb878432-8062-464f-a2dd-01cae08ff26f', 'enforce_multipath': True} {{(pid=87359) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4975}} Jul 10 04:55:08 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-50bf22b1-0f86-4c84-a797-1f70aa28db42 req-b5c3fec9-499a-4136-8018-d2807a24ef45 tempest-TestServerVolumeAttachmentScenario-230733730 None] attachment_update completed successfully. Jul 10 04:55:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:55:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:55:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:55:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:15 devstack sudo[104209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:55:15 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:16 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.681s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:55:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:55:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:55:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:55:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-b04cd2ac-6509-4419-b4b5-0ca792dee955 req-8698ffa0-e352-4335-b500-668f27982f4a tempest-TestServerVolumeAttachmentScenario-230733730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-b04cd2ac-6509-4419-b4b5-0ca792dee955 req-8698ffa0-e352-4335-b500-668f27982f4a tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:17 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfdd8c3-dad7-4129-a26b-7905ef570a4d]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-b04cd2ac-6509-4419-b4b5-0ca792dee955 req-8698ffa0-e352-4335-b500-668f27982f4a tempest-TestServerVolumeAttachmentScenario-230733730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f36ed659-cdba-4928-9f21-67ffa12eaa06 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:17 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f36ed659-cdba-4928-9f21-67ffa12eaa06 Jul 10 04:55:17 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:18 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-b04cd2ac-6509-4419-b4b5-0ca792dee955 req-8698ffa0-e352-4335-b500-668f27982f4a tempest-TestServerVolumeAttachmentScenario-230733730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f36ed659-cdba-4928-9f21-67ffa12eaa06" returned: 0 in 0.799s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-b04cd2ac-6509-4419-b4b5-0ca792dee955 req-8698ffa0-e352-4335-b500-668f27982f4a tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.819s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-b04cd2ac-6509-4419-b4b5-0ca792dee955 req-8698ffa0-e352-4335-b500-668f27982f4a tempest-TestServerVolumeAttachmentScenario-230733730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31', 'name': 'volume-f36ed659-cdba-4928-9f21-67ffa12eaa06', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f02e09d-b620-4dab-80c0-5929e03c3216', 'enforce_multipath': True} {{(pid=87359) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4975}} Jul 10 04:55:18 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-b04cd2ac-6509-4419-b4b5-0ca792dee955 req-8698ffa0-e352-4335-b500-668f27982f4a tempest-TestServerVolumeAttachmentScenario-230733730 None] attachment_update completed successfully. Jul 10 04:55:23 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-21a6a0f5-aecf-4fc4-870a-53a0d96d6684 req-d5be96ff-b568-43a0-8fe3-cf10c8dd9ad1 tempest-TestServerVolumeAttachmentScenario-230733730 None] Terminate volume connection completed successfully. Jul 10 04:55:23 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-21a6a0f5-aecf-4fc4-870a-53a0d96d6684 req-d5be96ff-b568-43a0-8fe3-cf10c8dd9ad1 tempest-TestServerVolumeAttachmentScenario-230733730 None] Deleting attachment 7f02e09d-b620-4dab-80c0-5929e03c3216. {{(pid=87359) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5106}} Jul 10 04:55:27 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-0a6d3ef6-e959-46cf-8000-231c17639ea2 req-4c02fdce-452f-4855-840e-54743986f7c2 tempest-TestServerVolumeAttachmentScenario-230733730 None] Terminate volume connection completed successfully. Jul 10 04:55:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-0a6d3ef6-e959-46cf-8000-231c17639ea2 req-4c02fdce-452f-4855-840e-54743986f7c2 tempest-TestServerVolumeAttachmentScenario-230733730 None] Deleting attachment eb878432-8062-464f-a2dd-01cae08ff26f. {{(pid=87359) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5106}} Jul 10 04:55:37 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=15,cinder:UPDATE=1 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:55:37 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:55:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-234e85a2-3849-458e-bd09-a0e0295a9977 tempest-TestServerVolumeAttachmentScenario-230733730 None] Acquiring lock "cinder-f36ed659-cdba-4928-9f21-67ffa12eaa06-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-234e85a2-3849-458e-bd09-a0e0295a9977 tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "cinder-f36ed659-cdba-4928-9f21-67ffa12eaa06-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-234e85a2-3849-458e-bd09-a0e0295a9977 tempest-TestServerVolumeAttachmentScenario-230733730 None] Acquiring lock "cinder-quobyte-f36ed659-cdba-4928-9f21-67ffa12eaa06" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-234e85a2-3849-458e-bd09-a0e0295a9977 tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "cinder-quobyte-f36ed659-cdba-4928-9f21-67ffa12eaa06" acquired by "delete_volume" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:37 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28b951b-32ec-4e8b-8b75-776f23c7f0e3]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-234e85a2-3849-458e-bd09-a0e0295a9977 tempest-TestServerVolumeAttachmentScenario-230733730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f36ed659-cdba-4928-9f21-67ffa12eaa06 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:37 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f36ed659-cdba-4928-9f21-67ffa12eaa06 Jul 10 04:55:37 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:38 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-234e85a2-3849-458e-bd09-a0e0295a9977 tempest-TestServerVolumeAttachmentScenario-230733730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f36ed659-cdba-4928-9f21-67ffa12eaa06" returned: 0 in 0.786s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-234e85a2-3849-458e-bd09-a0e0295a9977 tempest-TestServerVolumeAttachmentScenario-230733730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f36ed659-cdba-4928-9f21-67ffa12eaa06 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:38 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f36ed659-cdba-4928-9f21-67ffa12eaa06 Jul 10 04:55:38 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:39 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-234e85a2-3849-458e-bd09-a0e0295a9977 tempest-TestServerVolumeAttachmentScenario-230733730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-f36ed659-cdba-4928-9f21-67ffa12eaa06" returned: 0 in 0.674s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-234e85a2-3849-458e-bd09-a0e0295a9977 tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "cinder-quobyte-f36ed659-cdba-4928-9f21-67ffa12eaa06" released by "delete_volume" :: held 1.497s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:39 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-234e85a2-3849-458e-bd09-a0e0295a9977 tempest-TestServerVolumeAttachmentScenario-230733730 None] Created reservations ['692c6992-6254-4744-95f8-135c60846c50', '9fa8a9be-3d9e-4448-b7e7-01dba7e32d73', 'eb5d904c-f50c-4cfb-bbf2-81fe3d5a90fa', 'e085f1f4-82bc-40b9-bec1-a1a675e74bce'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:55:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-234e85a2-3849-458e-bd09-a0e0295a9977 tempest-TestServerVolumeAttachmentScenario-230733730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-234e85a2-3849-458e-bd09-a0e0295a9977 tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-234e85a2-3849-458e-bd09-a0e0295a9977 tempest-TestServerVolumeAttachmentScenario-230733730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:55:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-234e85a2-3849-458e-bd09-a0e0295a9977 tempest-TestServerVolumeAttachmentScenario-230733730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:55:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-234e85a2-3849-458e-bd09-a0e0295a9977 tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-234e85a2-3849-458e-bd09-a0e0295a9977 tempest-TestServerVolumeAttachmentScenario-230733730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:39 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:55:39 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-87dd2476-aaf8-49d3-acd9-cbe5f4372a44 tempest-TestServerVolumeAttachmentScenario-230733730 None] Acquiring lock "cinder-02147d50-ef1c-4bd8-bbe0-413731d877fc-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-87dd2476-aaf8-49d3-acd9-cbe5f4372a44 tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "cinder-02147d50-ef1c-4bd8-bbe0-413731d877fc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-87dd2476-aaf8-49d3-acd9-cbe5f4372a44 tempest-TestServerVolumeAttachmentScenario-230733730 None] Acquiring lock "cinder-quobyte-02147d50-ef1c-4bd8-bbe0-413731d877fc" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-87dd2476-aaf8-49d3-acd9-cbe5f4372a44 tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "cinder-quobyte-02147d50-ef1c-4bd8-bbe0-413731d877fc" acquired by "delete_volume" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:39 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec02d288-c538-423d-9300-1a11fcd69993]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-87dd2476-aaf8-49d3-acd9-cbe5f4372a44 tempest-TestServerVolumeAttachmentScenario-230733730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-02147d50-ef1c-4bd8-bbe0-413731d877fc {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:39 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-234e85a2-3849-458e-bd09-a0e0295a9977 tempest-TestServerVolumeAttachmentScenario-230733730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.669s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:39 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-234e85a2-3849-458e-bd09-a0e0295a9977 tempest-TestServerVolumeAttachmentScenario-230733730 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:55:39 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-234e85a2-3849-458e-bd09-a0e0295a9977 tempest-TestServerVolumeAttachmentScenario-230733730 None] Deleted volume successfully. Jul 10 04:55:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-234e85a2-3849-458e-bd09-a0e0295a9977 tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "cinder-f36ed659-cdba-4928-9f21-67ffa12eaa06-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:40 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-02147d50-ef1c-4bd8-bbe0-413731d877fc Jul 10 04:55:40 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:40 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-87dd2476-aaf8-49d3-acd9-cbe5f4372a44 tempest-TestServerVolumeAttachmentScenario-230733730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-02147d50-ef1c-4bd8-bbe0-413731d877fc" returned: 0 in 0.765s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-87dd2476-aaf8-49d3-acd9-cbe5f4372a44 tempest-TestServerVolumeAttachmentScenario-230733730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-02147d50-ef1c-4bd8-bbe0-413731d877fc {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:40 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-02147d50-ef1c-4bd8-bbe0-413731d877fc Jul 10 04:55:40 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:41 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-87dd2476-aaf8-49d3-acd9-cbe5f4372a44 tempest-TestServerVolumeAttachmentScenario-230733730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-02147d50-ef1c-4bd8-bbe0-413731d877fc" returned: 0 in 0.639s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-87dd2476-aaf8-49d3-acd9-cbe5f4372a44 tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "cinder-quobyte-02147d50-ef1c-4bd8-bbe0-413731d877fc" released by "delete_volume" :: held 1.445s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:41 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-87dd2476-aaf8-49d3-acd9-cbe5f4372a44 tempest-TestServerVolumeAttachmentScenario-230733730 None] Created reservations ['5c9d4624-0e37-4782-95da-d1ef2faee628', '8fce1368-d7fd-4394-9097-489b06076bf3', '209407fe-9199-463d-820c-48045d16922c', 'f12d3139-af20-41da-912b-a3991dd87556'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:55:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-87dd2476-aaf8-49d3-acd9-cbe5f4372a44 tempest-TestServerVolumeAttachmentScenario-230733730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-87dd2476-aaf8-49d3-acd9-cbe5f4372a44 tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-87dd2476-aaf8-49d3-acd9-cbe5f4372a44 tempest-TestServerVolumeAttachmentScenario-230733730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:55:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-87dd2476-aaf8-49d3-acd9-cbe5f4372a44 tempest-TestServerVolumeAttachmentScenario-230733730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:55:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-87dd2476-aaf8-49d3-acd9-cbe5f4372a44 tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-87dd2476-aaf8-49d3-acd9-cbe5f4372a44 tempest-TestServerVolumeAttachmentScenario-230733730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:41 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:55:41 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:42 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-87dd2476-aaf8-49d3-acd9-cbe5f4372a44 tempest-TestServerVolumeAttachmentScenario-230733730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.652s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:42 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-87dd2476-aaf8-49d3-acd9-cbe5f4372a44 tempest-TestServerVolumeAttachmentScenario-230733730 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:55:42 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-87dd2476-aaf8-49d3-acd9-cbe5f4372a44 tempest-TestServerVolumeAttachmentScenario-230733730 None] Deleted volume successfully. Jul 10 04:55:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-87dd2476-aaf8-49d3-acd9-cbe5f4372a44 tempest-TestServerVolumeAttachmentScenario-230733730 None] Lock "cinder-02147d50-ef1c-4bd8-bbe0-413731d877fc-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:51 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=19 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:55:52 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=13,cinder:SELECT=7,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:56:10 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=1 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:56:10 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=1 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:56:11 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:56:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Flow 'volume_create_manager' (07d75dab-86c5-4527-b40a-9cf66b1170ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:56:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e2db30-b198-4038-8726-f6de7d10499e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e2db30-b198-4038-8726-f6de7d10499e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1880014142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba93518-4b67-40d3-82a4-e8f16ee85f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4dea48531b4e0aa762e32259d53ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:56:12Z,use_quota=True,user_id='cc4b906b3e2c4420905e23a438d25da5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30228267-213a-46bc-99e9-d63c0ef5465a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30228267-213a-46bc-99e9-d63c0ef5465a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb943b9-677a-4f24-9b6f-ef2ebd3f308f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:12 devstack cinder-volume[87359]: DEBUG cinder.image.glance [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Creating Keystone auth plugin from conf {{(pid=87359) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 04:56:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb943b9-677a-4f24-9b6f-ef2ebd3f308f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dba93518-4b67-40d3-82a4-e8f16ee85f5b', 'volume_name': 'volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b', 'volume_size': 1, 'image_id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fde3189e780b4bb09257315f8463a754', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'created_at': datetime.datetime(2026, 7, 10, 2, 27, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 27, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f148b33-7c87-45fa-9b71-3295f9e93abc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736e7735-7b89-47da-81f6-4650a705cf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736e7735-7b89-47da-81f6-4650a705cf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9466af-51f0-4c9d-8783-7dac3e53db47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:12 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Volume dba93518-4b67-40d3-82a4-e8f16ee85f5b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b', 'volume_size': 1, 'image_id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fde3189e780b4bb09257315f8463a754', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'created_at': datetime.datetime(2026, 7, 10, 2, 27, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 27, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f148b33-7c87-45fa-9b71-3295f9e93abc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 04:56:12 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Trying to clone dba93518-4b67-40d3-82a4-e8f16ee85f5b from image 7f148b33-7c87-45fa-9b71-3295f9e93abc at location (None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}]). {{(pid=87359) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 04:56:12 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_6osgr55mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Jul 10 04:56:12 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Image download 20.69 MB at 20.69 MB/s Jul 10 04:56:12 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca09345-b583-4f2a-a442-d22c5e818759]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_6osgr55mdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:12 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_6osgr55mdevstack@QuobyteHD Jul 10 04:56:12 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:13 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_6osgr55mdevstack@QuobyteHD" returned: 0 in 0.706s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:13 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Temporary image 7f148b33-7c87-45fa-9b71-3295f9e93abc is fetched for user cc4b906b3e2c4420905e23a438d25da5. {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Jul 10 04:56:13 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5272cc8-b9a7-4733-88df-4eb0fe99e51a]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_6osgr55mdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:13 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_6osgr55mdevstack@QuobyteHD Jul 10 04:56:13 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:14 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_6osgr55mdevstack@QuobyteHD" returned: 0 in 0.702s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1880014142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba93518-4b67-40d3-82a4-e8f16ee85f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4dea48531b4e0aa762e32259d53ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:56:12Z,use_quota=True,user_id='cc4b906b3e2c4420905e23a438d25da5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:56:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Creating volume dba93518-4b67-40d3-82a4-e8f16ee85f5b {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:56:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:56:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:56:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:56:14 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:56:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:14 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b 1073741824 Jul 10 04:56:14 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:15 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b 1073741824" returned: 0 in 0.766s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:15 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b Jul 10 04:56:15 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:15 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b" returned: 0 in 0.615s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:56:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:15 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Attempting download of 7f148b33-7c87-45fa-9b71-3295f9e93abc ((None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}])) to volume dba93518-4b67-40d3-82a4-e8f16ee85f5b. {{(pid=87359) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 04:56:15 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da3007e-003d-4601-a469-987ef1035752]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_zr3m_z_m {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:15 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_zr3m_z_m Jul 10 04:56:15 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:56:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:56:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:56:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:15 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:56:15 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:16 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_zr3m_z_m" returned: 0 in 0.723s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_zr3m_z_m {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:16 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.653s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:56:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:56:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:56:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:56:16 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_zr3m_z_m Jul 10 04:56:16 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:17 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_zr3m_z_m" returned: 1 in 0.719s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f148b33-7c87-45fa-9b71-3295f9e93abc_zr3m_z_m' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:56:17 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e49611-5014-46ac-bc36-8c9699a53784]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_6osgr55mdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:17 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_6osgr55mdevstack@QuobyteHD Jul 10 04:56:17 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:17 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_6osgr55mdevstack@QuobyteHD" returned: 0 in 0.711s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:17 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] 7f148b33-7c87-45fa-9b71-3295f9e93abc was qcow2, converting to raw {{(pid=87359) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Jul 10 04:56:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_6osgr55mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:17 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_6osgr55mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b Jul 10 04:56:17 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:19 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_6osgr55mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b" returned: 0 in 1.711s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:19 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7f148b33-7c87-45fa-9b71-3295f9e93abc_6osgr55mdevstack@QuobyteHD, size 112.00 MB, duration 1.71 sec, destination /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:56:19 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Converted 112.00 MB image at 65.40 MB/s Jul 10 04:56:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:19 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b 1G Jul 10 04:56:19 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:20 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b 1G" returned: 0 in 0.644s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:20 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1198616-ce29-4733-86fb-3947b354738f]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:20 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b Jul 10 04:56:20 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:21 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b" returned: 0 in 0.708s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:21 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b Jul 10 04:56:21 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:21 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b" returned: 1 in 0.714s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:56:21 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Downloaded image 7f148b33-7c87-45fa-9b71-3295f9e93abc ((None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}])) to volume dba93518-4b67-40d3-82a4-e8f16ee85f5b successfully. {{(pid=87359) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 04:56:21 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Temporary image 7f148b33-7c87-45fa-9b71-3295f9e93abc for user cc4b906b3e2c4420905e23a438d25da5 is deleted. {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Jul 10 04:56:21 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Marking volume dba93518-4b67-40d3-82a4-e8f16ee85f5b as bootable. {{(pid=87359) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 04:56:21 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Copying metadata from image 7f148b33-7c87-45fa-9b71-3295f9e93abc to dba93518-4b67-40d3-82a4-e8f16ee85f5b. {{(pid=87359) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 04:56:21 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Creating volume glance metadata for volume dba93518-4b67-40d3-82a4-e8f16ee85f5b backed by image 7f148b33-7c87-45fa-9b71-3295f9e93abc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87359) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 04:56:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9466af-51f0-4c9d-8783-7dac3e53db47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b', 'volume_size': 1, 'image_id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f148b33-7c87-45fa-9b71-3295f9e93abc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fde3189e780b4bb09257315f8463a754', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f148b33-7c87-45fa-9b71-3295f9e93abc', 'created_at': datetime.datetime(2026, 7, 10, 2, 27, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 27, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f148b33-7c87-45fa-9b71-3295f9e93abc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f8483f-167f-4eda-97ae-94756977e9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:21 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Volume volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b (dba93518-4b67-40d3-82a4-e8f16ee85f5b): created successfully Jul 10 04:56:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f8483f-167f-4eda-97ae-94756977e9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Flow 'volume_create_manager' (07d75dab-86c5-4527-b40a-9cf66b1170ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:56:21 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ff29ecec-7f02-4eab-9756-b99192f84703 tempest-TestShelveInstance-1244040715 None] Created volume successfully. Jul 10 04:56:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-6907af31-3ec6-47e1-8f77-1c4cbb1a04b8 req-aaeb8e11-2290-4c31-b79d-345383a90683 tempest-TestShelveInstance-1244040715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-6907af31-3ec6-47e1-8f77-1c4cbb1a04b8 req-aaeb8e11-2290-4c31-b79d-345383a90683 tempest-TestShelveInstance-1244040715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:29 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7ce93d-bf1d-43fa-94f3-84113516d95f]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-6907af31-3ec6-47e1-8f77-1c4cbb1a04b8 req-aaeb8e11-2290-4c31-b79d-345383a90683 tempest-TestShelveInstance-1244040715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:29 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b Jul 10 04:56:29 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:30 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-6907af31-3ec6-47e1-8f77-1c4cbb1a04b8 req-aaeb8e11-2290-4c31-b79d-345383a90683 tempest-TestShelveInstance-1244040715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b" returned: 0 in 0.729s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-6907af31-3ec6-47e1-8f77-1c4cbb1a04b8 req-aaeb8e11-2290-4c31-b79d-345383a90683 tempest-TestShelveInstance-1244040715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:30 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b Jul 10 04:56:30 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:30 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-6907af31-3ec6-47e1-8f77-1c4cbb1a04b8 req-aaeb8e11-2290-4c31-b79d-345383a90683 tempest-TestShelveInstance-1244040715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b" returned: 1 in 0.697s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-6907af31-3ec6-47e1-8f77-1c4cbb1a04b8 req-aaeb8e11-2290-4c31-b79d-345383a90683 tempest-TestShelveInstance-1244040715 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:56:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-6907af31-3ec6-47e1-8f77-1c4cbb1a04b8 req-aaeb8e11-2290-4c31-b79d-345383a90683 tempest-TestShelveInstance-1244040715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.460s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:30 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-6907af31-3ec6-47e1-8f77-1c4cbb1a04b8 req-aaeb8e11-2290-4c31-b79d-345383a90683 tempest-TestShelveInstance-1244040715 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31', 'name': 'volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46d24c68-fa5e-4d60-a2aa-155ee37e460b', 'enforce_multipath': True} {{(pid=87359) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4975}} Jul 10 04:56:31 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-6907af31-3ec6-47e1-8f77-1c4cbb1a04b8 req-aaeb8e11-2290-4c31-b79d-345383a90683 tempest-TestShelveInstance-1244040715 None] attachment_update completed successfully. Jul 10 04:56:40 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=13,cinder:UPDATE=7,cinder:INSERT=8 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:56:41 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=17,cinder:INSERT=6,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:57:06 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-e060eedc-95b8-495d-a3ea-18b09a36ef6e req-14092de9-acc4-4b83-80f6-6d10d9985780 tempest-TestShelveInstance-1244040715 None] Terminate volume connection completed successfully. Jul 10 04:57:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-e060eedc-95b8-495d-a3ea-18b09a36ef6e req-14092de9-acc4-4b83-80f6-6d10d9985780 tempest-TestShelveInstance-1244040715 None] Deleting attachment 46d24c68-fa5e-4d60-a2aa-155ee37e460b. {{(pid=87359) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5106}} Jul 10 04:57:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-55a2cd31-92e0-4b59-8902-c72100235107 req-5893fc0b-35c7-4b47-9e7e-609e3809313f tempest-TestShelveInstance-1244040715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:57:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-55a2cd31-92e0-4b59-8902-c72100235107 req-5893fc0b-35c7-4b47-9e7e-609e3809313f tempest-TestShelveInstance-1244040715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:57:11 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac7e7b1-db6c-4bb6-884c-4780a1a33d45]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:57:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-55a2cd31-92e0-4b59-8902-c72100235107 req-5893fc0b-35c7-4b47-9e7e-609e3809313f tempest-TestShelveInstance-1244040715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:11 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b Jul 10 04:57:11 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:12 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-55a2cd31-92e0-4b59-8902-c72100235107 req-5893fc0b-35c7-4b47-9e7e-609e3809313f tempest-TestShelveInstance-1244040715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b" returned: 0 in 0.737s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-55a2cd31-92e0-4b59-8902-c72100235107 req-5893fc0b-35c7-4b47-9e7e-609e3809313f tempest-TestShelveInstance-1244040715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:12 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b Jul 10 04:57:12 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:13 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-55a2cd31-92e0-4b59-8902-c72100235107 req-5893fc0b-35c7-4b47-9e7e-609e3809313f tempest-TestShelveInstance-1244040715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b" returned: 1 in 0.725s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-55a2cd31-92e0-4b59-8902-c72100235107 req-5893fc0b-35c7-4b47-9e7e-609e3809313f tempest-TestShelveInstance-1244040715 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:57:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-55a2cd31-92e0-4b59-8902-c72100235107 req-5893fc0b-35c7-4b47-9e7e-609e3809313f tempest-TestShelveInstance-1244040715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.508s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:57:13 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-55a2cd31-92e0-4b59-8902-c72100235107 req-5893fc0b-35c7-4b47-9e7e-609e3809313f tempest-TestShelveInstance-1244040715 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31', 'name': 'volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '87c7fac1-9ecf-4245-8610-8250d6a62116', 'enforce_multipath': True} {{(pid=87359) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4975}} Jul 10 04:57:13 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-55a2cd31-92e0-4b59-8902-c72100235107 req-5893fc0b-35c7-4b47-9e7e-609e3809313f tempest-TestShelveInstance-1244040715 None] attachment_update completed successfully. Jul 10 04:57:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:57:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:57:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:57:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:57:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:57:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:57:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:15 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:57:15 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:16 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.676s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:57:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:57:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:57:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:57:23 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:57:23 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:57:50 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-a5f76a5a-6dfc-4ae0-8f1e-e2647dee55c2 tempest-TestShelveInstance-1244040715 None] Terminate volume connection completed successfully. Jul 10 04:57:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-a5f76a5a-6dfc-4ae0-8f1e-e2647dee55c2 tempest-TestShelveInstance-1244040715 None] Deleting attachment 87c7fac1-9ecf-4245-8610-8250d6a62116. {{(pid=87359) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5106}} Jul 10 04:57:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] Acquiring lock "cinder-dba93518-4b67-40d3-82a4-e8f16ee85f5b-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:57:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] Lock "cinder-dba93518-4b67-40d3-82a4-e8f16ee85f5b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:57:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] Acquiring lock "cinder-quobyte-dba93518-4b67-40d3-82a4-e8f16ee85f5b" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:57:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] Lock "cinder-quobyte-dba93518-4b67-40d3-82a4-e8f16ee85f5b" acquired by "delete_volume" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:57:51 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96e2b37-39b2-4f7d-bc3b-67e043c2dc07]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:57:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:51 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b Jul 10 04:57:51 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:52 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b" returned: 0 in 0.739s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:52 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b Jul 10 04:57:52 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:52 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b" returned: 1 in 0.736s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:57:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:52 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b Jul 10 04:57:52 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:53 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-dba93518-4b67-40d3-82a4-e8f16ee85f5b" returned: 0 in 0.674s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] Lock "cinder-quobyte-dba93518-4b67-40d3-82a4-e8f16ee85f5b" released by "delete_volume" :: held 2.213s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:57:53 devstack cinder-volume[87359]: DEBUG cinder.quota [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] Created reservations ['a1793287-7288-4138-b9bc-6863e41cd55e', '04138035-117c-46f0-9836-569710fd8ce0', 'c8f154f0-6494-4b8f-8903-5c92f1a33646', '147791f2-84fb-4854-baab-5fe9445b3570'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:57:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:57:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:57:53 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:57:53 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:57:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:57:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:53 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:57:53 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:54 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.617s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:54 devstack cinder-volume[87359]: DEBUG cinder.manager [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:57:54 devstack cinder-volume[87359]: INFO cinder.volume.manager [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] Deleted volume successfully. Jul 10 04:57:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [req-75329484-ad6e-4724-ba96-3fe73a9b338c req-1c197077-1990-455c-ac67-f1f5d5d23309 tempest-TestShelveInstance-1244040715 None] Lock "cinder-dba93518-4b67-40d3-82a4-e8f16ee85f5b-delete_volume" released by "delete_volume" :: held 3.042s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:58:07 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:58:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Flow 'volume_create_manager' (7ae3a8f3-b6ab-4586-ad1a-dc4e3efecc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:58:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9982ae-1bf9-4114-a939-f28f5f74812a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:58:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9982ae-1bf9-4114-a939-f28f5f74812a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7686e5aa-66a4-4ff7-ac9c-7056e3ae051a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee16c86d69c4934879ce1765f3bdd09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:58:08Z,use_quota=True,user_id='3530f2a3ac8142838117f598d1ae116f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(478be87c-887b-4da8-b942-27a74ea9ecee),volume_type_id=478be87c-887b-4da8-b942-27a74ea9ecee)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:58:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b4cff63-006d-43c3-9289-3c4a44258e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:58:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b4cff63-006d-43c3-9289-3c4a44258e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:58:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91b191f4-e627-4de2-bc7e-51f8dc470d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:58:07 devstack cinder-volume[87359]: DEBUG cinder.image.glance [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Creating Keystone auth plugin from conf {{(pid=87359) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 04:58:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91b191f4-e627-4de2-bc7e-51f8dc470d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7686e5aa-66a4-4ff7-ac9c-7056e3ae051a', 'volume_name': 'volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a', 'volume_size': 1, 'image_id': '5d1e0571-35de-47ae-8ba1-362e3f85cedd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d1e0571-35de-47ae-8ba1-362e3f85cedd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b0c8b24f9d47f0ba422e8d158f1befa4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cee16c86d69c4934879ce1765f3bdd09', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '96ffed06e99f35838942fa9622122fc2ef8d75270f5e79de352b57ccbd9351235ae51a6b82937d94efdba0f1f24e13a462fe0a486a05d5c4e9803043228a2bbd', 'id': '5d1e0571-35de-47ae-8ba1-362e3f85cedd', 'created_at': datetime.datetime(2026, 7, 10, 2, 58, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 58, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d1e0571-35de-47ae-8ba1-362e3f85cedd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:58:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8266f3cb-22cf-4e10-bf7f-29a61e13ebf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:58:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8266f3cb-22cf-4e10-bf7f-29a61e13ebf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:58:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533aae23-b63d-441a-a135-0625bac774a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:58:07 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Volume 7686e5aa-66a4-4ff7-ac9c-7056e3ae051a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a', 'volume_size': 1, 'image_id': '5d1e0571-35de-47ae-8ba1-362e3f85cedd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d1e0571-35de-47ae-8ba1-362e3f85cedd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b0c8b24f9d47f0ba422e8d158f1befa4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cee16c86d69c4934879ce1765f3bdd09', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '96ffed06e99f35838942fa9622122fc2ef8d75270f5e79de352b57ccbd9351235ae51a6b82937d94efdba0f1f24e13a462fe0a486a05d5c4e9803043228a2bbd', 'id': '5d1e0571-35de-47ae-8ba1-362e3f85cedd', 'created_at': datetime.datetime(2026, 7, 10, 2, 58, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 58, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d1e0571-35de-47ae-8ba1-362e3f85cedd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 04:58:07 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Trying to clone 7686e5aa-66a4-4ff7-ac9c-7056e3ae051a from image 5d1e0571-35de-47ae-8ba1-362e3f85cedd at location (None, [{'url': 'file:///opt/stack/data/glance/images/5d1e0571-35de-47ae-8ba1-362e3f85cedd', 'metadata': {}}]). {{(pid=87359) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 04:58:07 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Jul 10 04:58:07 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Image download 0.00 MB at 0.00 MB/s Jul 10 04:58:08 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[96627824-0b13-47b1-be89-6964112c29d1]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:58:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:08 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD Jul 10 04:58:08 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:08 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD" returned: 0 in 0.754s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:08 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD Jul 10 04:58:08 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:09 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD" returned: 1 in 0.731s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:58:09 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Temporary image 5d1e0571-35de-47ae-8ba1-362e3f85cedd is fetched for user 3530f2a3ac8142838117f598d1ae116f. {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Jul 10 04:58:09 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1fd9c1-785c-47b5-9227-6a4098c37278]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:58:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:09 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD Jul 10 04:58:09 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:10 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD" returned: 0 in 0.719s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:10 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD Jul 10 04:58:10 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:10 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD" returned: 1 in 0.716s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:58:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:58:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:58:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7686e5aa-66a4-4ff7-ac9c-7056e3ae051a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee16c86d69c4934879ce1765f3bdd09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:58:08Z,use_quota=True,user_id='3530f2a3ac8142838117f598d1ae116f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(478be87c-887b-4da8-b942-27a74ea9ecee),volume_type_id=478be87c-887b-4da8-b942-27a74ea9ecee)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:58:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Creating volume 7686e5aa-66a4-4ff7-ac9c-7056e3ae051a {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:58:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:58:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:58:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:58:11 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:58:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:58:11 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:58:11 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:58:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:11 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a 1073741824 Jul 10 04:58:11 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:11 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a 1073741824" returned: 0 in 0.819s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:11 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a Jul 10 04:58:11 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:12 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a" returned: 0 in 0.642s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:58:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:58:12 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Attempting download of 5d1e0571-35de-47ae-8ba1-362e3f85cedd ((None, [{'url': 'file:///opt/stack/data/glance/images/5d1e0571-35de-47ae-8ba1-362e3f85cedd', 'metadata': {}}])) to volume 7686e5aa-66a4-4ff7-ac9c-7056e3ae051a. {{(pid=87359) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 04:58:12 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd0ad09-cdb1-4cf0-8215-cc6fcd425381]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:58:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d1e0571-35de-47ae-8ba1-362e3f85cedd_cyroiilw {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:12 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d1e0571-35de-47ae-8ba1-362e3f85cedd_cyroiilw Jul 10 04:58:12 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:13 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d1e0571-35de-47ae-8ba1-362e3f85cedd_cyroiilw" returned: 0 in 0.723s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d1e0571-35de-47ae-8ba1-362e3f85cedd_cyroiilw {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:13 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d1e0571-35de-47ae-8ba1-362e3f85cedd_cyroiilw Jul 10 04:58:13 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:13 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d1e0571-35de-47ae-8ba1-362e3f85cedd_cyroiilw" returned: 1 in 0.713s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d1e0571-35de-47ae-8ba1-362e3f85cedd_cyroiilw' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:58:14 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b392192-6e50-4e94-a915-c3f72870b585]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:58:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:14 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD Jul 10 04:58:14 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:14 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD" returned: 0 in 0.720s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:14 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD Jul 10 04:58:14 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:15 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD" returned: 1 in 0.703s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:58:15 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] 5d1e0571-35de-47ae-8ba1-362e3f85cedd was raw, converting to raw {{(pid=87359) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Jul 10 04:58:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:15 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a Jul 10 04:58:15 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:58:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:58:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:58:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:58:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:58:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:58:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:15 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:58:15 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:16 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a" returned: 0 in 0.704s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:16 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5d1e0571-35de-47ae-8ba1-362e3f85cedd_nkmkcbtmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:58:16 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 04:58:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:16 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a 1G Jul 10 04:58:16 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:16 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.655s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:58:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:58:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:58:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:58:16 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a 1G" returned: 0 in 0.668s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:16 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d03df0-d2ea-4178-bb60-96b7c5a1fde2]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:58:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:16 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a Jul 10 04:58:16 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:17 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a" returned: 0 in 0.727s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:17 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a Jul 10 04:58:17 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:18 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a" returned: 1 in 0.731s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:58:18 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Downloaded image 5d1e0571-35de-47ae-8ba1-362e3f85cedd ((None, [{'url': 'file:///opt/stack/data/glance/images/5d1e0571-35de-47ae-8ba1-362e3f85cedd', 'metadata': {}}])) to volume 7686e5aa-66a4-4ff7-ac9c-7056e3ae051a successfully. {{(pid=87359) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 04:58:18 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Temporary image 5d1e0571-35de-47ae-8ba1-362e3f85cedd for user 3530f2a3ac8142838117f598d1ae116f is deleted. {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Jul 10 04:58:18 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Marking volume 7686e5aa-66a4-4ff7-ac9c-7056e3ae051a as bootable. {{(pid=87359) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 04:58:18 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Copying metadata from image 5d1e0571-35de-47ae-8ba1-362e3f85cedd to 7686e5aa-66a4-4ff7-ac9c-7056e3ae051a. {{(pid=87359) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 04:58:18 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Creating volume glance metadata for volume 7686e5aa-66a4-4ff7-ac9c-7056e3ae051a backed by image 5d1e0571-35de-47ae-8ba1-362e3f85cedd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5d1e0571-35de-47ae-8ba1-362e3f85cedd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b0c8b24f9d47f0ba422e8d158f1befa4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87359) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 04:58:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533aae23-b63d-441a-a135-0625bac774a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a', 'volume_size': 1, 'image_id': '5d1e0571-35de-47ae-8ba1-362e3f85cedd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d1e0571-35de-47ae-8ba1-362e3f85cedd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b0c8b24f9d47f0ba422e8d158f1befa4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cee16c86d69c4934879ce1765f3bdd09', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '96ffed06e99f35838942fa9622122fc2ef8d75270f5e79de352b57ccbd9351235ae51a6b82937d94efdba0f1f24e13a462fe0a486a05d5c4e9803043228a2bbd', 'id': '5d1e0571-35de-47ae-8ba1-362e3f85cedd', 'created_at': datetime.datetime(2026, 7, 10, 2, 58, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 58, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d1e0571-35de-47ae-8ba1-362e3f85cedd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:58:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1637a360-e5e2-46af-8315-cd63646c648b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:58:18 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Volume volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a (7686e5aa-66a4-4ff7-ac9c-7056e3ae051a): created successfully Jul 10 04:58:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1637a360-e5e2-46af-8315-cd63646c648b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:58:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Flow 'volume_create_manager' (7ae3a8f3-b6ab-4586-ad1a-dc4e3efecc7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:58:18 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ccf06a64-bd6a-40db-9ffc-8b5f801f139d tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Created volume successfully. Jul 10 04:58:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Acquiring lock "cinder-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:58:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Lock "cinder-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:58:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Acquiring lock "cinder-quobyte-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:58:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Lock "cinder-quobyte-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:58:19 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb546b6b-aad9-47b0-81ac-fef676e210f6]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:58:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:19 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a Jul 10 04:58:19 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:20 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a" returned: 0 in 0.743s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:20 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a Jul 10 04:58:20 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:20 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a" returned: 1 in 0.739s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:58:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:20 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a Jul 10 04:58:20 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:21 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a" returned: 0 in 0.656s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:21 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Lock "cinder-quobyte-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a" released by "delete_volume" :: held 2.199s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:58:21 devstack cinder-volume[87359]: WARNING cinder.quota [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:58:21 devstack cinder-volume[87359]: WARNING cinder.quota [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:58:21 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Created reservations ['8acdd946-9a22-4c74-8eda-8693d3b32983', 'c9f82a39-94b8-4a79-a068-f0d1c23b02d4', 'b798f3f3-e7d8-4404-b457-003fb4af3289', '20590bf6-cb96-41b2-a7d1-7cc91d795a46'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:58:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:58:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:58:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:58:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:58:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:58:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:21 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:58:21 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:22 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.631s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:22 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:58:22 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Deleted volume successfully. Jul 10 04:58:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-02b92f78-84de-45eb-9b23-fc0a6287be7a tempest-VolumeAndVolumeTypeFromImageTest-212784451 None] Lock "cinder-7686e5aa-66a4-4ff7-ac9c-7056e3ae051a-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:58:28 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:58:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Flow 'volume_create_manager' (ed790c32-5346-462f-a10e-49a4841353b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:58:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722a3627-4318-44ed-8f03-4a4a7d5d2dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:58:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722a3627-4318-44ed-8f03-4a4a7d5d2dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec9413ed-3353-4082-ad9d-6a224331b0d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc61c118c9a9426e908e03be4cb60a40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:58:29Z,use_quota=True,user_id='143a80406b09417ca93d404171f9dbec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:58:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f804387-b441-4069-b6b3-87d1d1bd5377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:58:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f804387-b441-4069-b6b3-87d1d1bd5377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:58:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1b433f-002e-4245-a869-92fd0dce4331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:58:28 devstack cinder-volume[87359]: DEBUG cinder.image.glance [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Creating Keystone auth plugin from conf {{(pid=87359) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 04:58:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1b433f-002e-4245-a869-92fd0dce4331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ec9413ed-3353-4082-ad9d-6a224331b0d1', 'volume_name': 'volume-ec9413ed-3353-4082-ad9d-6a224331b0d1', 'volume_size': 1, 'image_id': 'e6080fa7-c7b3-4763-a1f1-08f9364b0617', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e6080fa7-c7b3-4763-a1f1-08f9364b0617', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1ca0e40a590ced3c75eda9e717827763', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc61c118c9a9426e908e03be4cb60a40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd74482d805e87911259aa18422aefec4848113b38420f27fb9b72012b85ef6261a17d797528ca03748e9992289592f63b3a9c2de653163ca4466f66c033b2834', 'id': 'e6080fa7-c7b3-4763-a1f1-08f9364b0617', 'created_at': datetime.datetime(2026, 7, 10, 2, 58, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 58, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e6080fa7-c7b3-4763-a1f1-08f9364b0617/file', 'properties': {}}, 'image_service': }' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:58:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0fb5b6f-b438-41f1-ac69-10f7fd2987c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:58:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0fb5b6f-b438-41f1-ac69-10f7fd2987c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:58:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b2a8a23-c8b7-43c6-aa7b-d6dc1c757795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:58:29 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Volume ec9413ed-3353-4082-ad9d-6a224331b0d1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ec9413ed-3353-4082-ad9d-6a224331b0d1', 'volume_size': 1, 'image_id': 'e6080fa7-c7b3-4763-a1f1-08f9364b0617', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e6080fa7-c7b3-4763-a1f1-08f9364b0617', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1ca0e40a590ced3c75eda9e717827763', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc61c118c9a9426e908e03be4cb60a40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd74482d805e87911259aa18422aefec4848113b38420f27fb9b72012b85ef6261a17d797528ca03748e9992289592f63b3a9c2de653163ca4466f66c033b2834', 'id': 'e6080fa7-c7b3-4763-a1f1-08f9364b0617', 'created_at': datetime.datetime(2026, 7, 10, 2, 58, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 58, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e6080fa7-c7b3-4763-a1f1-08f9364b0617/file', 'properties': {}}, 'image_service': } Jul 10 04:58:29 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Trying to clone ec9413ed-3353-4082-ad9d-6a224331b0d1 from image e6080fa7-c7b3-4763-a1f1-08f9364b0617 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e6080fa7-c7b3-4763-a1f1-08f9364b0617', 'metadata': {}}]). {{(pid=87359) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 04:58:29 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Jul 10 04:58:29 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Image download 0.00 MB at 0.00 MB/s Jul 10 04:58:29 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cdc767-ef66-41f1-a878-c70e7783551e]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:58:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:29 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD Jul 10 04:58:29 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:29 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD" returned: 0 in 0.709s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:30 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD Jul 10 04:58:30 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:30 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD" returned: 1 in 0.695s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:58:30 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Temporary image e6080fa7-c7b3-4763-a1f1-08f9364b0617 is fetched for user 143a80406b09417ca93d404171f9dbec. {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Jul 10 04:58:30 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0974f4-209b-43e6-9f90-c036f01b782c]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:58:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:30 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD Jul 10 04:58:30 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:31 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD" returned: 0 in 0.724s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:31 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD Jul 10 04:58:31 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:32 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD" returned: 1 in 0.696s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:58:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:58:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:58:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec9413ed-3353-4082-ad9d-6a224331b0d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc61c118c9a9426e908e03be4cb60a40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:58:29Z,use_quota=True,user_id='143a80406b09417ca93d404171f9dbec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:58:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Creating volume ec9413ed-3353-4082-ad9d-6a224331b0d1 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:58:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:58:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:58:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:58:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:58:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:58:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:58:32 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:58:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:32 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1 1073741824 Jul 10 04:58:32 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:32 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1 1073741824" returned: 0 in 0.853s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:33 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1 Jul 10 04:58:33 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:33 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1" returned: 0 in 0.643s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:58:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:58:33 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Attempting download of e6080fa7-c7b3-4763-a1f1-08f9364b0617 ((None, [{'url': 'file:///opt/stack/data/glance/images/e6080fa7-c7b3-4763-a1f1-08f9364b0617', 'metadata': {}}])) to volume ec9413ed-3353-4082-ad9d-6a224331b0d1. {{(pid=87359) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 04:58:33 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[366d1506-c6e5-4b1d-bf9c-eb4f70c5a8cd]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:58:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ij5j4ixe {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:33 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ij5j4ixe Jul 10 04:58:33 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:34 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ij5j4ixe" returned: 0 in 0.718s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ij5j4ixe {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:34 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ij5j4ixe Jul 10 04:58:34 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:35 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ij5j4ixe" returned: 1 in 0.709s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ij5j4ixe' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:58:35 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36e5fdc-d892-45e1-8221-45437c13f4cf]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:58:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:35 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD Jul 10 04:58:35 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:35 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD" returned: 0 in 0.717s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:35 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD Jul 10 04:58:36 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:36 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD" returned: 1 in 0.730s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:58:36 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] e6080fa7-c7b3-4763-a1f1-08f9364b0617 was raw, converting to raw {{(pid=87359) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Jul 10 04:58:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:36 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1 Jul 10 04:58:36 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:37 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1" returned: 0 in 0.723s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:37 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e6080fa7-c7b3-4763-a1f1-08f9364b0617_ejdgvsc3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1 {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:58:37 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 04:58:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:37 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1 1G Jul 10 04:58:37 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:38 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1 1G" returned: 0 in 0.648s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:38 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[2222c3f4-b6bc-4596-92a4-294fe7cd825b]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:58:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:38 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1 Jul 10 04:58:38 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:38 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1" returned: 0 in 0.738s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:38 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1 Jul 10 04:58:38 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:39 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1" returned: 1 in 0.739s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:58:39 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Downloaded image e6080fa7-c7b3-4763-a1f1-08f9364b0617 ((None, [{'url': 'file:///opt/stack/data/glance/images/e6080fa7-c7b3-4763-a1f1-08f9364b0617', 'metadata': {}}])) to volume ec9413ed-3353-4082-ad9d-6a224331b0d1 successfully. {{(pid=87359) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 04:58:39 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Temporary image e6080fa7-c7b3-4763-a1f1-08f9364b0617 for user 143a80406b09417ca93d404171f9dbec is deleted. {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Jul 10 04:58:39 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Marking volume ec9413ed-3353-4082-ad9d-6a224331b0d1 as bootable. {{(pid=87359) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 04:58:39 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Copying metadata from image e6080fa7-c7b3-4763-a1f1-08f9364b0617 to ec9413ed-3353-4082-ad9d-6a224331b0d1. {{(pid=87359) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 04:58:39 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Creating volume glance metadata for volume ec9413ed-3353-4082-ad9d-6a224331b0d1 backed by image e6080fa7-c7b3-4763-a1f1-08f9364b0617 with: {'image_id': 'e6080fa7-c7b3-4763-a1f1-08f9364b0617', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1ca0e40a590ced3c75eda9e717827763', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87359) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 04:58:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b2a8a23-c8b7-43c6-aa7b-d6dc1c757795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec9413ed-3353-4082-ad9d-6a224331b0d1', 'volume_size': 1, 'image_id': 'e6080fa7-c7b3-4763-a1f1-08f9364b0617', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e6080fa7-c7b3-4763-a1f1-08f9364b0617', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1ca0e40a590ced3c75eda9e717827763', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc61c118c9a9426e908e03be4cb60a40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd74482d805e87911259aa18422aefec4848113b38420f27fb9b72012b85ef6261a17d797528ca03748e9992289592f63b3a9c2de653163ca4466f66c033b2834', 'id': 'e6080fa7-c7b3-4763-a1f1-08f9364b0617', 'created_at': datetime.datetime(2026, 7, 10, 2, 58, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 58, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e6080fa7-c7b3-4763-a1f1-08f9364b0617/file', 'properties': {}}, 'image_service': }' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:58:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b52590-8afd-40b8-b6e3-b0f14330b623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:58:39 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Volume volume-ec9413ed-3353-4082-ad9d-6a224331b0d1 (ec9413ed-3353-4082-ad9d-6a224331b0d1): created successfully Jul 10 04:58:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b52590-8afd-40b8-b6e3-b0f14330b623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:58:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Flow 'volume_create_manager' (ed790c32-5346-462f-a10e-49a4841353b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:58:39 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d0da08e3-172e-445e-b6db-4a3c56d46775 tempest-VolumeImageDependencyTests-94728622 None] Created volume successfully. Jul 10 04:58:40 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] Acquiring lock "cinder-ec9413ed-3353-4082-ad9d-6a224331b0d1-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:58:40 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] Lock "cinder-ec9413ed-3353-4082-ad9d-6a224331b0d1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:58:40 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] Acquiring lock "cinder-quobyte-ec9413ed-3353-4082-ad9d-6a224331b0d1" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:58:40 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] Lock "cinder-quobyte-ec9413ed-3353-4082-ad9d-6a224331b0d1" acquired by "delete_volume" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:58:40 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b803565-743a-4b79-956a-0898f5ccbba7]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:58:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:40 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1 Jul 10 04:58:40 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:41 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1" returned: 0 in 0.729s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:41 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1 Jul 10 04:58:41 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:42 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1" returned: 1 in 0.734s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:58:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:42 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1 Jul 10 04:58:42 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:42 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ec9413ed-3353-4082-ad9d-6a224331b0d1" returned: 0 in 0.656s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] Lock "cinder-quobyte-ec9413ed-3353-4082-ad9d-6a224331b0d1" released by "delete_volume" :: held 2.177s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:58:42 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] Created reservations ['f5e2c574-ca64-4a0b-b720-da0d9c1dddf0', 'bc64045a-5a84-4650-83b7-9e280a71b415', '986164a5-cc6e-49ac-8caa-38e8c12a668b', '09bafd9c-79e1-46e9-95ce-a7234e10cece'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:58:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:58:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:58:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:58:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:58:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:58:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:58:42 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:58:42 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:58:43 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jul 10 04:58:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.616s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:58:43 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:58:43 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] Deleted volume successfully. Jul 10 04:58:43 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=36,cinder:INSERT=16,cinder:UPDATE=27,cinder:DELETE=3 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:58:43 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1ecaf6ed-2f23-4fcd-a83c-06c3eb4b218b tempest-VolumeImageDependencyTests-94728622 None] Lock "cinder-ec9413ed-3353-4082-ad9d-6a224331b0d1-delete_volume" released by "delete_volume" :: held 2.975s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:58:52 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=28,cinder:UPDATE=40,cinder:INSERT=17,cinder:DELETE=2 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:59:04 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:59:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Flow 'volume_create_manager' (575189f6-9a9b-45cd-b7c1-a4386d36ec77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3c6bbb-d400-4d06-89aa-01e90880ea1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3c6bbb-d400-4d06-89aa-01e90880ea1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1841267550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e728151-e333-4e0c-b46c-24d46677fdc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e3d64b6cd94f02988dcf7f63830904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:05Z,use_quota=True,user_id='b7b563cc91744855a39566b2811054f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5559c189-1580-4158-8f09-9898e9acd804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5559c189-1580-4158-8f09-9898e9acd804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b36b372-245e-423c-b321-14fca27962e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:05 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b36b372-245e-423c-b321-14fca27962e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e728151-e333-4e0c-b46c-24d46677fdc7', 'volume_name': 'volume-8e728151-e333-4e0c-b46c-24d46677fdc7', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:05 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389463c3-6ace-4403-acd6-1b78c0e9bc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:05 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389463c3-6ace-4403-acd6-1b78c0e9bc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:05 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d211cde9-b03f-4288-9d1f-636c386caeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:05 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Volume 8e728151-e333-4e0c-b46c-24d46677fdc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e728151-e333-4e0c-b46c-24d46677fdc7', 'volume_size': 1} Jul 10 04:59:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1841267550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e728151-e333-4e0c-b46c-24d46677fdc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e3d64b6cd94f02988dcf7f63830904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:05Z,use_quota=True,user_id='b7b563cc91744855a39566b2811054f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:59:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Creating volume 8e728151-e333-4e0c-b46c-24d46677fdc7 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:59:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:59:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:59:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:59:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:59:05 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:59:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:05 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7 1073741824 Jul 10 04:59:05 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:05 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7 1073741824" returned: 0 in 0.797s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:05 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7 Jul 10 04:59:05 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:06 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7" returned: 0 in 0.646s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:59:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:59:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d211cde9-b03f-4288-9d1f-636c386caeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e728151-e333-4e0c-b46c-24d46677fdc7', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153f8c98-5269-4d17-b4c4-cbfe51f2989f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:06 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Volume volume-8e728151-e333-4e0c-b46c-24d46677fdc7 (8e728151-e333-4e0c-b46c-24d46677fdc7): created successfully Jul 10 04:59:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153f8c98-5269-4d17-b4c4-cbfe51f2989f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Flow 'volume_create_manager' (575189f6-9a9b-45cd-b7c1-a4386d36ec77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:06 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-fa942991-c3c0-49ec-aa9e-f9e6d31bd198 tempest-SnapshotDependencyTests-438193528 None] Created volume successfully. Jul 10 04:59:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-37ae0758-4383-48fa-a165-7702b6117808 tempest-SnapshotDependencyTests-438193528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-37ae0758-4383-48fa-a165-7702b6117808 tempest-SnapshotDependencyTests-438193528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-37ae0758-4383-48fa-a165-7702b6117808 tempest-SnapshotDependencyTests-438193528 None] Creating offline snapshot 1b375712-9253-469a-886f-2f4e0926f93c of volume 8e728151-e333-4e0c-b46c-24d46677fdc7 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:59:07 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf06a0a-b4f4-415a-b215-b803622b479b]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:59:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-37ae0758-4383-48fa-a165-7702b6117808 tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:07 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7 Jul 10 04:59:07 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:07 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-37ae0758-4383-48fa-a165-7702b6117808 tempest-SnapshotDependencyTests-438193528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7" returned: 0 in 0.746s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-37ae0758-4383-48fa-a165-7702b6117808 tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:08 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c 1G Jul 10 04:59:08 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:08 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-37ae0758-4383-48fa-a165-7702b6117808 tempest-SnapshotDependencyTests-438193528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c 1G" returned: 0 in 0.772s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-37ae0758-4383-48fa-a165-7702b6117808 tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e728151-e333-4e0c-b46c-24d46677fdc7 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:08 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e728151-e333-4e0c-b46c-24d46677fdc7 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c Jul 10 04:59:08 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:09 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-37ae0758-4383-48fa-a165-7702b6117808 tempest-SnapshotDependencyTests-438193528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e728151-e333-4e0c-b46c-24d46677fdc7 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c" returned: 0 in 0.672s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:09 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-37ae0758-4383-48fa-a165-7702b6117808 tempest-SnapshotDependencyTests-438193528 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c is being set with open permissions: ugo+rw Jul 10 04:59:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-37ae0758-4383-48fa-a165-7702b6117808 tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:09 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c Jul 10 04:59:09 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:10 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-37ae0758-4383-48fa-a165-7702b6117808 tempest-SnapshotDependencyTests-438193528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c" returned: 0 in 0.615s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-37ae0758-4383-48fa-a165-7702b6117808 tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:10 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.info Jul 10 04:59:10 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:10 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-37ae0758-4383-48fa-a165-7702b6117808 tempest-SnapshotDependencyTests-438193528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.info" returned: 0 in 0.616s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:10 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-37ae0758-4383-48fa-a165-7702b6117808 tempest-SnapshotDependencyTests-438193528 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.info is being set with open permissions: ugo+rw Jul 10 04:59:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-37ae0758-4383-48fa-a165-7702b6117808 tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:10 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.info Jul 10 04:59:10 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:11 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-37ae0758-4383-48fa-a165-7702b6117808 tempest-SnapshotDependencyTests-438193528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.info" returned: 0 in 0.614s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-37ae0758-4383-48fa-a165-7702b6117808 tempest-SnapshotDependencyTests-438193528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.117s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:59:11 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-37ae0758-4383-48fa-a165-7702b6117808 tempest-SnapshotDependencyTests-438193528 None] Create snapshot completed successfully Jul 10 04:59:12 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:59:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Flow 'volume_create_manager' (2d1602ea-399e-4ff6-8980-8294fa90f3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d937fbaa-cc33-443f-8e14-0fbcd4cc1428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:12 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d937fbaa-cc33-443f-8e14-0fbcd4cc1428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4985c55d-2336-4033-8db7-100046c7ccfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e3d64b6cd94f02988dcf7f63830904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1b375712-9253-469a-886f-2f4e0926f93c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:13Z,use_quota=True,user_id='b7b563cc91744855a39566b2811054f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f17b79f-bdce-4b3a-8009-ac20118757f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f17b79f-bdce-4b3a-8009-ac20118757f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f05d286-a233-45b2-b437-cb86a8ac2811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f05d286-a233-45b2-b437-cb86a8ac2811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4985c55d-2336-4033-8db7-100046c7ccfb', 'volume_name': 'volume-4985c55d-2336-4033-8db7-100046c7ccfb', 'volume_size': 1, 'snapshot_id': '1b375712-9253-469a-886f-2f4e0926f93c'}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e37a002-88fb-491c-b19c-db7c49132f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e37a002-88fb-491c-b19c-db7c49132f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a21f6c6-5a18-4f2b-b256-9cda1e95cd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:13 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Volume 4985c55d-2336-4033-8db7-100046c7ccfb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4985c55d-2336-4033-8db7-100046c7ccfb', 'volume_size': 1, 'snapshot_id': '1b375712-9253-469a-886f-2f4e0926f93c'} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Acquiring lock "cinder-quobyte-1b375712-9253-469a-886f-2f4e0926f93c-4985c55d-2336-4033-8db7-100046c7ccfb" by "_create_volume_from_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Lock "cinder-quobyte-1b375712-9253-469a-886f-2f4e0926f93c-4985c55d-2336-4033-8db7-100046c7ccfb" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Creating volume 4985c55d-2336-4033-8db7-100046c7ccfb from snapshot 1b375712-9253-469a-886f-2f4e0926f93c {{(pid=87359) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Acquiring lock "cinder-quobyte-4985c55d-2336-4033-8db7-100046c7ccfb" by "_copy_volume_from_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Lock "cinder-quobyte-4985c55d-2336-4033-8db7-100046c7ccfb" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] snapshot: 1b375712-9253-469a-886f-2f4e0926f93c, volume: 4985c55d-2336-4033-8db7-100046c7ccfb, {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd8b894-7113-46ac-aad6-1b59d3f94261]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:13 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c Jul 10 04:59:13 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:13 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c" returned: 0 in 0.753s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e728151-e333-4e0c-b46c-24d46677fdc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7 {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Creating direct copy from snapshot {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e0c8bc-0482-4a60-9141-cacad253d9f8]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:59:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:13 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7 Jul 10 04:59:13 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:14 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7" returned: 0 in 0.720s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:14 devstack cinder-volume[87359]: DEBUG cinder.utils [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Path /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4985c55d-2336-4033-8db7-100046c7ccfb not found in is_blk_device check {{(pid=87359) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 04:59:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4985c55d-2336-4033-8db7-100046c7ccfb {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:14 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4985c55d-2336-4033-8db7-100046c7ccfb Jul 10 04:59:14 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:59:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:59:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:59:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:59:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:16 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:59:16 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:16 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.996s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:59:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:59:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 04:59:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 04:59:19 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4985c55d-2336-4033-8db7-100046c7ccfb" returned: 0 in 4.661s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:19 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76370dc-d0b7-4298-aa29-6479f57fde87]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:59:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:19 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7 Jul 10 04:59:19 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:20 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7" returned: 0 in 0.931s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:20 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7, size 1024.00 MB, duration 4.66 sec, destination /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4985c55d-2336-4033-8db7-100046c7ccfb {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:59:20 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Converted 1024.00 MB image at 219.66 MB/s Jul 10 04:59:20 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4985c55d-2336-4033-8db7-100046c7ccfb is being set with open permissions: ugo+rw Jul 10 04:59:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4985c55d-2336-4033-8db7-100046c7ccfb {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:20 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4985c55d-2336-4033-8db7-100046c7ccfb Jul 10 04:59:20 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:20 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4985c55d-2336-4033-8db7-100046c7ccfb" returned: 0 in 0.644s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:20 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Lock "cinder-quobyte-4985c55d-2336-4033-8db7-100046c7ccfb" released by "_copy_volume_from_snapshot" :: held 7.790s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:59:20 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Lock "cinder-quobyte-1b375712-9253-469a-886f-2f4e0926f93c-4985c55d-2336-4033-8db7-100046c7ccfb" released by "_create_volume_from_snapshot" :: held 7.817s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:59:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.832s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:59:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a21f6c6-5a18-4f2b-b256-9cda1e95cd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4985c55d-2336-4033-8db7-100046c7ccfb', 'volume_size': 1, 'snapshot_id': '1b375712-9253-469a-886f-2f4e0926f93c'}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9006d436-cb83-4c90-9496-e863661fdfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:20 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Volume volume-4985c55d-2336-4033-8db7-100046c7ccfb (4985c55d-2336-4033-8db7-100046c7ccfb): created successfully Jul 10 04:59:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9006d436-cb83-4c90-9496-e863661fdfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Flow 'volume_create_manager' (2d1602ea-399e-4ff6-8980-8294fa90f3b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:20 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-f4c47d47-ed27-4d2d-95e7-01dff893f170 tempest-SnapshotDependencyTests-438193528 None] Created volume successfully. Jul 10 04:59:21 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-057bf678-6018-4118-abb5-7739b548ce51 tempest-SnapshotDependencyTests-438193528 None] Acquiring lock "cinder-1b375712-9253-469a-886f-2f4e0926f93c-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:59:21 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-057bf678-6018-4118-abb5-7739b548ce51 tempest-SnapshotDependencyTests-438193528 None] Lock "cinder-1b375712-9253-469a-886f-2f4e0926f93c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:59:21 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-057bf678-6018-4118-abb5-7739b548ce51 tempest-SnapshotDependencyTests-438193528 None] Acquiring lock "cinder-quobyte-8e728151-e333-4e0c-b46c-24d46677fdc7" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:59:21 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-057bf678-6018-4118-abb5-7739b548ce51 tempest-SnapshotDependencyTests-438193528 None] Lock "cinder-quobyte-8e728151-e333-4e0c-b46c-24d46677fdc7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:59:21 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-057bf678-6018-4118-abb5-7739b548ce51 tempest-SnapshotDependencyTests-438193528 None] Acquiring lock "cinder-quobyte-1b375712-9253-469a-886f-2f4e0926f93c" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:59:21 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-057bf678-6018-4118-abb5-7739b548ce51 tempest-SnapshotDependencyTests-438193528 None] Lock "cinder-quobyte-1b375712-9253-469a-886f-2f4e0926f93c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:59:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-057bf678-6018-4118-abb5-7739b548ce51 tempest-SnapshotDependencyTests-438193528 None] Deleting offline snapshot 1b375712-9253-469a-886f-2f4e0926f93c of volume 8e728151-e333-4e0c-b46c-24d46677fdc7 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:59:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-057bf678-6018-4118-abb5-7739b548ce51 tempest-SnapshotDependencyTests-438193528 None] snapshot_file for this snap is: volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:59:21 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ff4d95-0f08-4d00-a848-5f890519ab09]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:59:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-057bf678-6018-4118-abb5-7739b548ce51 tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:21 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c Jul 10 04:59:21 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:22 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-057bf678-6018-4118-abb5-7739b548ce51 tempest-SnapshotDependencyTests-438193528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c" returned: 0 in 0.748s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-057bf678-6018-4118-abb5-7739b548ce51 tempest-SnapshotDependencyTests-438193528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e728151-e333-4e0c-b46c-24d46677fdc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:59:22 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f274f0d-8554-49ed-b80e-b93830525a0f]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:59:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-057bf678-6018-4118-abb5-7739b548ce51 tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:22 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7 Jul 10 04:59:22 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:23 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-057bf678-6018-4118-abb5-7739b548ce51 tempest-SnapshotDependencyTests-438193528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7" returned: 0 in 0.737s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-057bf678-6018-4118-abb5-7739b548ce51 tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:23 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c Jul 10 04:59:23 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:23 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-057bf678-6018-4118-abb5-7739b548ce51 tempest-SnapshotDependencyTests-438193528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c" returned: 0 in 0.711s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-057bf678-6018-4118-abb5-7739b548ce51 tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:23 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c Jul 10 04:59:23 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:24 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-057bf678-6018-4118-abb5-7739b548ce51 tempest-SnapshotDependencyTests-438193528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7.1b375712-9253-469a-886f-2f4e0926f93c" returned: 0 in 0.626s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-057bf678-6018-4118-abb5-7739b548ce51 tempest-SnapshotDependencyTests-438193528 None] Lock "cinder-quobyte-1b375712-9253-469a-886f-2f4e0926f93c" released by "_delete_snapshot" :: held 2.919s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:59:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-057bf678-6018-4118-abb5-7739b548ce51 tempest-SnapshotDependencyTests-438193528 None] Lock "cinder-quobyte-8e728151-e333-4e0c-b46c-24d46677fdc7" released by "delete_snapshot" :: held 2.943s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:59:24 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-057bf678-6018-4118-abb5-7739b548ce51 tempest-SnapshotDependencyTests-438193528 None] Created reservations ['f7aaceed-4a76-4d12-8bd4-5e8d275d3c56', '17e7e053-c3fc-42ce-a1ca-6f751bbd3e33', '75450b0e-77d2-448c-beca-6c979b3fe691', '214e06ae-9abc-465e-bc79-e3c0eee05d23'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:59:24 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-057bf678-6018-4118-abb5-7739b548ce51 tempest-SnapshotDependencyTests-438193528 None] Delete snapshot completed successfully. Jul 10 04:59:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-057bf678-6018-4118-abb5-7739b548ce51 tempest-SnapshotDependencyTests-438193528 None] Lock "cinder-1b375712-9253-469a-886f-2f4e0926f93c-delete_snapshot" released by "delete_snapshot" :: held 3.075s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:59:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a52d0125-7cd2-4de7-8716-c79162c8fb1b tempest-SnapshotDependencyTests-438193528 None] Acquiring lock "cinder-8e728151-e333-4e0c-b46c-24d46677fdc7-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:59:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a52d0125-7cd2-4de7-8716-c79162c8fb1b tempest-SnapshotDependencyTests-438193528 None] Lock "cinder-8e728151-e333-4e0c-b46c-24d46677fdc7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:59:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a52d0125-7cd2-4de7-8716-c79162c8fb1b tempest-SnapshotDependencyTests-438193528 None] Acquiring lock "cinder-quobyte-8e728151-e333-4e0c-b46c-24d46677fdc7" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:59:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a52d0125-7cd2-4de7-8716-c79162c8fb1b tempest-SnapshotDependencyTests-438193528 None] Lock "cinder-quobyte-8e728151-e333-4e0c-b46c-24d46677fdc7" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:59:24 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebcdcc6-6c9c-4e4e-a877-2b726ef596e8]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:59:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a52d0125-7cd2-4de7-8716-c79162c8fb1b tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:24 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7 Jul 10 04:59:24 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:25 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a52d0125-7cd2-4de7-8716-c79162c8fb1b tempest-SnapshotDependencyTests-438193528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7" returned: 0 in 0.720s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a52d0125-7cd2-4de7-8716-c79162c8fb1b tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:25 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7 Jul 10 04:59:25 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:26 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a52d0125-7cd2-4de7-8716-c79162c8fb1b tempest-SnapshotDependencyTests-438193528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8e728151-e333-4e0c-b46c-24d46677fdc7" returned: 0 in 0.643s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:26 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a52d0125-7cd2-4de7-8716-c79162c8fb1b tempest-SnapshotDependencyTests-438193528 None] Lock "cinder-quobyte-8e728151-e333-4e0c-b46c-24d46677fdc7" released by "delete_volume" :: held 1.420s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:59:26 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-a52d0125-7cd2-4de7-8716-c79162c8fb1b tempest-SnapshotDependencyTests-438193528 None] Created reservations ['b90e337b-04a8-411c-936f-68af5cb4b3db', '0609c802-67d2-4c41-9be0-e883303bc4ee', '70859bda-01b4-48c7-8f56-8facb6f64c8c', '424d27f2-f3ea-4ee0-a06c-bc561dd76f57'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:59:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a52d0125-7cd2-4de7-8716-c79162c8fb1b tempest-SnapshotDependencyTests-438193528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a52d0125-7cd2-4de7-8716-c79162c8fb1b tempest-SnapshotDependencyTests-438193528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a52d0125-7cd2-4de7-8716-c79162c8fb1b tempest-SnapshotDependencyTests-438193528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:59:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a52d0125-7cd2-4de7-8716-c79162c8fb1b tempest-SnapshotDependencyTests-438193528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:59:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a52d0125-7cd2-4de7-8716-c79162c8fb1b tempest-SnapshotDependencyTests-438193528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:59:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a52d0125-7cd2-4de7-8716-c79162c8fb1b tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:26 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:59:26 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:26 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d0382a61-45ac-4e7f-a533-67ae3e8abb48 tempest-SnapshotDependencyTests-438193528 None] Acquiring lock "cinder-4985c55d-2336-4033-8db7-100046c7ccfb-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:59:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d0382a61-45ac-4e7f-a533-67ae3e8abb48 tempest-SnapshotDependencyTests-438193528 None] Lock "cinder-4985c55d-2336-4033-8db7-100046c7ccfb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:59:27 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a52d0125-7cd2-4de7-8716-c79162c8fb1b tempest-SnapshotDependencyTests-438193528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.646s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:27 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-a52d0125-7cd2-4de7-8716-c79162c8fb1b tempest-SnapshotDependencyTests-438193528 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:59:27 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a52d0125-7cd2-4de7-8716-c79162c8fb1b tempest-SnapshotDependencyTests-438193528 None] Deleted volume successfully. Jul 10 04:59:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a52d0125-7cd2-4de7-8716-c79162c8fb1b tempest-SnapshotDependencyTests-438193528 None] Lock "cinder-8e728151-e333-4e0c-b46c-24d46677fdc7-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:59:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d0382a61-45ac-4e7f-a533-67ae3e8abb48 tempest-SnapshotDependencyTests-438193528 None] Acquiring lock "cinder-quobyte-4985c55d-2336-4033-8db7-100046c7ccfb" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:59:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d0382a61-45ac-4e7f-a533-67ae3e8abb48 tempest-SnapshotDependencyTests-438193528 None] Lock "cinder-quobyte-4985c55d-2336-4033-8db7-100046c7ccfb" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:59:27 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d00ad37-b7d7-4e3f-ade7-6f9e6b154914]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:59:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0382a61-45ac-4e7f-a533-67ae3e8abb48 tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4985c55d-2336-4033-8db7-100046c7ccfb {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:27 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4985c55d-2336-4033-8db7-100046c7ccfb Jul 10 04:59:27 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:27 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0382a61-45ac-4e7f-a533-67ae3e8abb48 tempest-SnapshotDependencyTests-438193528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4985c55d-2336-4033-8db7-100046c7ccfb" returned: 0 in 0.729s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0382a61-45ac-4e7f-a533-67ae3e8abb48 tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4985c55d-2336-4033-8db7-100046c7ccfb {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:27 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4985c55d-2336-4033-8db7-100046c7ccfb Jul 10 04:59:27 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:28 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0382a61-45ac-4e7f-a533-67ae3e8abb48 tempest-SnapshotDependencyTests-438193528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4985c55d-2336-4033-8db7-100046c7ccfb" returned: 0 in 0.642s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d0382a61-45ac-4e7f-a533-67ae3e8abb48 tempest-SnapshotDependencyTests-438193528 None] Lock "cinder-quobyte-4985c55d-2336-4033-8db7-100046c7ccfb" released by "delete_volume" :: held 1.407s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:59:28 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-d0382a61-45ac-4e7f-a533-67ae3e8abb48 tempest-SnapshotDependencyTests-438193528 None] Created reservations ['9834faeb-5c93-4b65-b3fc-a2569015a2f0', '3a4f809b-aa2d-4cd7-8b40-938ca1ddc8ec', '5ae1066f-e77a-460b-bfd2-30f316b6126a', 'a079f07e-2747-4b24-b08b-5b8a993a42cc'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:59:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d0382a61-45ac-4e7f-a533-67ae3e8abb48 tempest-SnapshotDependencyTests-438193528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d0382a61-45ac-4e7f-a533-67ae3e8abb48 tempest-SnapshotDependencyTests-438193528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d0382a61-45ac-4e7f-a533-67ae3e8abb48 tempest-SnapshotDependencyTests-438193528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:59:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d0382a61-45ac-4e7f-a533-67ae3e8abb48 tempest-SnapshotDependencyTests-438193528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:59:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d0382a61-45ac-4e7f-a533-67ae3e8abb48 tempest-SnapshotDependencyTests-438193528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:59:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0382a61-45ac-4e7f-a533-67ae3e8abb48 tempest-SnapshotDependencyTests-438193528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:28 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 04:59:28 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:29 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d0382a61-45ac-4e7f-a533-67ae3e8abb48 tempest-SnapshotDependencyTests-438193528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.661s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:29 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-d0382a61-45ac-4e7f-a533-67ae3e8abb48 tempest-SnapshotDependencyTests-438193528 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:59:29 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d0382a61-45ac-4e7f-a533-67ae3e8abb48 tempest-SnapshotDependencyTests-438193528 None] Deleted volume successfully. Jul 10 04:59:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d0382a61-45ac-4e7f-a533-67ae3e8abb48 tempest-SnapshotDependencyTests-438193528 None] Lock "cinder-4985c55d-2336-4033-8db7-100046c7ccfb-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:59:38 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=28,cinder:SELECT=23,cinder:INSERT=6 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:59:39 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=24,cinder:INSERT=8,cinder:UPDATE=28,cinder:DELETE=5 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Flow 'volume_create_manager' (1fa8e6aa-d584-4dec-9811-d9474fede588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7acead3b-060b-46cb-88bf-2b3296241603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7acead3b-060b-46cb-88bf-2b3296241603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1040903436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e0c446-d27d-44ec-a19a-5cc316b09132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac07514631cd4ef592ba902b55f69ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:48Z,use_quota=True,user_id='05fa1814feab491fba0b7d781fa4313a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce2389ca-20d7-4b24-904c-ac6ccfead9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce2389ca-20d7-4b24-904c-ac6ccfead9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78cb75fd-7ac2-4498-a290-9e7003860c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78cb75fd-7ac2-4498-a290-9e7003860c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69e0c446-d27d-44ec-a19a-5cc316b09132', 'volume_name': 'volume-69e0c446-d27d-44ec-a19a-5cc316b09132', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (705cd99b-634a-41d3-8fc2-bbe715a930f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (705cd99b-634a-41d3-8fc2-bbe715a930f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340c2c67-b8c3-4e66-b7f4-4ec34c113b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:48 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Volume 69e0c446-d27d-44ec-a19a-5cc316b09132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69e0c446-d27d-44ec-a19a-5cc316b09132', 'volume_size': 1} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1040903436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e0c446-d27d-44ec-a19a-5cc316b09132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac07514631cd4ef592ba902b55f69ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:48Z,use_quota=True,user_id='05fa1814feab491fba0b7d781fa4313a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Creating volume 69e0c446-d27d-44ec-a19a-5cc316b09132 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:59:48 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-69e0c446-d27d-44ec-a19a-5cc316b09132 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:48 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-69e0c446-d27d-44ec-a19a-5cc316b09132 1073741824 Jul 10 04:59:48 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Flow 'volume_create_manager' (7097bb01-2258-40e2-be7a-fa4d03b2b206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c727386-9668-445e-8aab-f478085341a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c727386-9668-445e-8aab-f478085341a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1272888359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=201c3fa7-9bc1-4a60-9dc8-6380f5de30ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a675eb8f724783aee0911d575ed5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:49Z,use_quota=True,user_id='ea5b8a11bd924ef9b49ca80827210129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24fca089-6210-43e2-b0bd-e609d6981ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24fca089-6210-43e2-b0bd-e609d6981ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef13e5c0-cacc-4866-b5b7-73cff795b09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef13e5c0-cacc-4866-b5b7-73cff795b09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '201c3fa7-9bc1-4a60-9dc8-6380f5de30ef', 'volume_name': 'volume-201c3fa7-9bc1-4a60-9dc8-6380f5de30ef', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae70591-1229-4b61-86f2-13ca0b639955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae70591-1229-4b61-86f2-13ca0b639955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38cb17d-ac82-4d12-8bf9-e4449a68ad9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:48 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Volume 201c3fa7-9bc1-4a60-9dc8-6380f5de30ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-201c3fa7-9bc1-4a60-9dc8-6380f5de30ef', 'volume_size': 1} Jul 10 04:59:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Flow 'volume_create_manager' (e3bb07a7-af05-4c72-a951-83657514b63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5cfb0e-997c-49f5-8692-a3a304ef1cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5cfb0e-997c-49f5-8692-a3a304ef1cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-865061624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=752fc120-a692-4601-81b4-8535ee48948f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a675eb8f724783aee0911d575ed5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:49Z,use_quota=True,user_id='ea5b8a11bd924ef9b49ca80827210129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c37a67-2fec-4c7a-97db-d71c6f8c0974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c37a67-2fec-4c7a-97db-d71c6f8c0974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5929406-d88a-422c-96d1-ee8e360a4e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5929406-d88a-422c-96d1-ee8e360a4e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '752fc120-a692-4601-81b4-8535ee48948f', 'volume_name': 'volume-752fc120-a692-4601-81b4-8535ee48948f', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbfee1b-881b-4f78-8f36-43b011c993c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbfee1b-881b-4f78-8f36-43b011c993c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f99011ff-2e82-4021-962d-9c39dac393d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:49 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Volume 752fc120-a692-4601-81b4-8535ee48948f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-752fc120-a692-4601-81b4-8535ee48948f', 'volume_size': 1} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Flow 'volume_create_manager' (581e436d-1267-422d-9409-1b615a0c2e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3a9256-aed3-4498-80a3-28266720f0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3a9256-aed3-4498-80a3-28266720f0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-136707012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44cd8e81-03f2-46fd-a63d-10539ff66a09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f1c4a47713c46b08df7d60f7caf062f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:50Z,use_quota=True,user_id='5fb974c7c8844199af122f5efa95f67c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb027f9-94b7-4c4a-8e1d-5583c224b262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb027f9-94b7-4c4a-8e1d-5583c224b262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:49 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8943fc54-741c-49ce-ac92-9d7c6e3eaf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8943fc54-741c-49ce-ac92-9d7c6e3eaf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44cd8e81-03f2-46fd-a63d-10539ff66a09', 'volume_name': 'volume-44cd8e81-03f2-46fd-a63d-10539ff66a09', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3831d70-62d7-4fed-900e-cc468213b166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3831d70-62d7-4fed-900e-cc468213b166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54ee734-d40e-4408-aadc-8f489badf5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:49 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Volume 44cd8e81-03f2-46fd-a63d-10539ff66a09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44cd8e81-03f2-46fd-a63d-10539ff66a09', 'volume_size': 1} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-69e0c446-d27d-44ec-a19a-5cc316b09132 1073741824" returned: 0 in 1.219s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-69e0c446-d27d-44ec-a19a-5cc316b09132 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:49 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-69e0c446-d27d-44ec-a19a-5cc316b09132 Jul 10 04:59:49 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Flow 'volume_create_manager' (21e9c29d-75cc-44ac-b833-cc46417bb98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b268ae9b-f047-457e-9b91-0af3192d7bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b268ae9b-f047-457e-9b91-0af3192d7bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-345093193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47038865-cfd5-425f-a86e-31a20428b429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a675eb8f724783aee0911d575ed5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:50Z,use_quota=True,user_id='ea5b8a11bd924ef9b49ca80827210129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3162a1d6-6fd0-401d-bc8f-7893165b18cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3162a1d6-6fd0-401d-bc8f-7893165b18cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca19ad81-c522-42dc-9098-2d3fd0c197d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca19ad81-c522-42dc-9098-2d3fd0c197d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47038865-cfd5-425f-a86e-31a20428b429', 'volume_name': 'volume-47038865-cfd5-425f-a86e-31a20428b429', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c7edb3-1946-4bfb-867c-56a26519606a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c7edb3-1946-4bfb-867c-56a26519606a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e74fe02-0871-417b-9cdc-5946762a18aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:50 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Volume 47038865-cfd5-425f-a86e-31a20428b429: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47038865-cfd5-425f-a86e-31a20428b429', 'volume_size': 1} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Flow 'volume_create_manager' (3fd56b0d-327a-47df-9ea0-e2eba5495088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbca295-9055-4889-896b-e64a08f818d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbca295-9055-4889-896b-e64a08f818d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1388878541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365de1be-98fb-4cce-b928-1327eeed087f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a675eb8f724783aee0911d575ed5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:50Z,use_quota=True,user_id='ea5b8a11bd924ef9b49ca80827210129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ae66e2-3dc1-4838-8e9f-d7977294a93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ae66e2-3dc1-4838-8e9f-d7977294a93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e87d4d-7e40-4971-ae6d-c343774d3832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e87d4d-7e40-4971-ae6d-c343774d3832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '365de1be-98fb-4cce-b928-1327eeed087f', 'volume_name': 'volume-365de1be-98fb-4cce-b928-1327eeed087f', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72e5c99-76ef-4569-a9d6-ed296f30db50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72e5c99-76ef-4569-a9d6-ed296f30db50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac928b8-82f9-4e58-af88-d0917bef18ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:50 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Volume 365de1be-98fb-4cce-b928-1327eeed087f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-365de1be-98fb-4cce-b928-1327eeed087f', 'volume_size': 1} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Flow 'volume_create_manager' (f40a71b2-b602-45d0-b4b4-27e13bc69541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e73274b-9e3a-47bc-ba2f-59018eb053dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e73274b-9e3a-47bc-ba2f-59018eb053dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-487051416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b20a39-8630-4bc6-8e16-ded978b86884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a675eb8f724783aee0911d575ed5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:50Z,use_quota=True,user_id='ea5b8a11bd924ef9b49ca80827210129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8347c27-3454-4d65-9f0c-bb57d3086fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8347c27-3454-4d65-9f0c-bb57d3086fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (137f6b5f-45d5-4213-9229-5f535853d8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (137f6b5f-45d5-4213-9229-5f535853d8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00b20a39-8630-4bc6-8e16-ded978b86884', 'volume_name': 'volume-00b20a39-8630-4bc6-8e16-ded978b86884', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d40316ad-89c7-40e7-bc30-9d3b2e9d5766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d40316ad-89c7-40e7-bc30-9d3b2e9d5766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ae0211-b88d-48b7-83bd-041833b5b446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:50 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Volume 00b20a39-8630-4bc6-8e16-ded978b86884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00b20a39-8630-4bc6-8e16-ded978b86884', 'volume_size': 1} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:50 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-69e0c446-d27d-44ec-a19a-5cc316b09132" returned: 0 in 0.768s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.777s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1272888359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=201c3fa7-9bc1-4a60-9dc8-6380f5de30ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a675eb8f724783aee0911d575ed5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:49Z,use_quota=True,user_id='ea5b8a11bd924ef9b49ca80827210129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Creating volume 201c3fa7-9bc1-4a60-9dc8-6380f5de30ef {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:59:50 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-201c3fa7-9bc1-4a60-9dc8-6380f5de30ef 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340c2c67-b8c3-4e66-b7f4-4ec34c113b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e0c446-d27d-44ec-a19a-5cc316b09132', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:50 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-201c3fa7-9bc1-4a60-9dc8-6380f5de30ef 1073741824 Jul 10 04:59:50 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6fbcad-5dba-4d39-9335-b6180f85be32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:50 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Volume volume-69e0c446-d27d-44ec-a19a-5cc316b09132 (69e0c446-d27d-44ec-a19a-5cc316b09132): created successfully Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6fbcad-5dba-4d39-9335-b6180f85be32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:50 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Flow 'volume_create_manager' (1fa8e6aa-d584-4dec-9811-d9474fede588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:50 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-94a019a4-3d2d-4b2e-a771-383e30622b71 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Created volume successfully. Jul 10 04:59:51 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-201c3fa7-9bc1-4a60-9dc8-6380f5de30ef 1073741824" returned: 0 in 0.899s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-201c3fa7-9bc1-4a60-9dc8-6380f5de30ef {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:51 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-201c3fa7-9bc1-4a60-9dc8-6380f5de30ef Jul 10 04:59:51 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:51 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Flow 'volume_create_manager' (500733b1-15fc-4d9f-bab7-1c3fe975b027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e1a028-1a59-4a49-a72c-8e7ca366b874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e1a028-1a59-4a49-a72c-8e7ca366b874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1870264640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bddc988f-0575-40d7-b89e-08df98271d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac07514631cd4ef592ba902b55f69ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:52Z,use_quota=True,user_id='05fa1814feab491fba0b7d781fa4313a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec314cb8-6fb1-460e-8c24-f7cf120e516c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec314cb8-6fb1-460e-8c24-f7cf120e516c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa187cbc-729d-44bd-a367-2b88df9956cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa187cbc-729d-44bd-a367-2b88df9956cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bddc988f-0575-40d7-b89e-08df98271d05', 'volume_name': 'volume-bddc988f-0575-40d7-b89e-08df98271d05', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bddc1157-c2e9-44d9-92f4-a386b73a04ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bddc1157-c2e9-44d9-92f4-a386b73a04ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6764557b-5b1f-4c15-8c46-58edd23dd2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:52 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Volume bddc988f-0575-40d7-b89e-08df98271d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bddc988f-0575-40d7-b89e-08df98271d05', 'volume_size': 1} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:59:52 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Flow 'volume_create_manager' (4f561c4c-1ae3-411f-8e76-b3cf3947f461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f51589f9-2554-40ee-839f-7bd565a498dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-201c3fa7-9bc1-4a60-9dc8-6380f5de30ef" returned: 0 in 0.830s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.935s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-865061624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=752fc120-a692-4601-81b4-8535ee48948f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a675eb8f724783aee0911d575ed5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:49Z,use_quota=True,user_id='ea5b8a11bd924ef9b49ca80827210129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Creating volume 752fc120-a692-4601-81b4-8535ee48948f {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:59:52 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-752fc120-a692-4601-81b4-8535ee48948f 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f51589f9-2554-40ee-839f-7bd565a498dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-364987223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68eaae9b-3977-4666-b3d9-e700cb48c586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac07514631cd4ef592ba902b55f69ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:52Z,use_quota=True,user_id='05fa1814feab491fba0b7d781fa4313a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6245dd4e-407d-46f8-81d8-dacd2ce944b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:52 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-752fc120-a692-4601-81b4-8535ee48948f 1073741824 Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6245dd4e-407d-46f8-81d8-dacd2ce944b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:52 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab6f1f8-64fc-4f0a-ae8e-2797b94a439b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab6f1f8-64fc-4f0a-ae8e-2797b94a439b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68eaae9b-3977-4666-b3d9-e700cb48c586', 'volume_name': 'volume-68eaae9b-3977-4666-b3d9-e700cb48c586', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (872299f5-98f7-4dbd-b45d-04ea25eb55d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (872299f5-98f7-4dbd-b45d-04ea25eb55d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf43f68-1fe1-456f-be51-d99eac8e13a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:52 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Volume 68eaae9b-3977-4666-b3d9-e700cb48c586: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68eaae9b-3977-4666-b3d9-e700cb48c586', 'volume_size': 1} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38cb17d-ac82-4d12-8bf9-e4449a68ad9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-201c3fa7-9bc1-4a60-9dc8-6380f5de30ef', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f377fb7a-c9f2-4b68-bd06-4d1a3880ed18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:52 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Volume volume-201c3fa7-9bc1-4a60-9dc8-6380f5de30ef (201c3fa7-9bc1-4a60-9dc8-6380f5de30ef): created successfully Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f377fb7a-c9f2-4b68-bd06-4d1a3880ed18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Flow 'volume_create_manager' (7097bb01-2258-40e2-be7a-fa4d03b2b206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:52 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-bdb46a04-2097-472f-88fd-0bbf6383c404 tempest-CreateVolumesFromImageTest-1498478426 None] Created volume successfully. Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Flow 'volume_create_manager' (81b9080c-27bb-41fa-8879-a7a36ec2a35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a521dec4-185a-4c32-9fe5-f027b513dd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a521dec4-185a-4c32-9fe5-f027b513dd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2caa2b-0689-4c36-8acd-23877eef0188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecafdbf8b801493dbaf82f0d488aedcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:53Z,use_quota=True,user_id='3bbe856181e24be38140b5af9aae28de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce976c7e-a128-44c2-b56d-f00f18eb7165),volume_type_id=ce976c7e-a128-44c2-b56d-f00f18eb7165)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a648778-5886-4c3c-bde2-1b227fce736f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a648778-5886-4c3c-bde2-1b227fce736f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8469bc5a-f9f3-40e4-a5a2-248b230cac99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.image.glance [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Creating Keystone auth plugin from conf {{(pid=87359) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Flow 'volume_create_manager' (7697c362-48e4-4119-a128-bed5c1d0ab17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4568c8e-4312-4704-ad3c-1261612920b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4568c8e-4312-4704-ad3c-1261612920b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-361440548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e74248a-8516-47a5-a170-e3daf013e556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac07514631cd4ef592ba902b55f69ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:53Z,use_quota=True,user_id='05fa1814feab491fba0b7d781fa4313a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38aa52c-4911-4712-864f-be2ab7242b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38aa52c-4911-4712-864f-be2ab7242b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0785ab-4e21-444b-9b62-5170596ebcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0785ab-4e21-444b-9b62-5170596ebcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e74248a-8516-47a5-a170-e3daf013e556', 'volume_name': 'volume-4e74248a-8516-47a5-a170-e3daf013e556', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a655c0ff-8fe3-45a4-83c9-ece4c5477443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a655c0ff-8fe3-45a4-83c9-ece4c5477443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b7e4050-4562-465d-ab7e-85d67145e8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:53 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Volume 4e74248a-8516-47a5-a170-e3daf013e556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e74248a-8516-47a5-a170-e3daf013e556', 'volume_size': 1} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Flow 'volume_create_manager' (acb98eb1-e84b-46ca-bb16-bb6ad68101e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e96b516-fdbf-4150-9afa-f8bfaffca712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e96b516-fdbf-4150-9afa-f8bfaffca712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-478561398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15607532-0715-4b5e-a95c-1e90e9a06d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac07514631cd4ef592ba902b55f69ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:53Z,use_quota=True,user_id='05fa1814feab491fba0b7d781fa4313a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e63088-196c-49a5-8977-377c74b6b664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e63088-196c-49a5-8977-377c74b6b664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018739fc-a556-426c-ad90-92715d858942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018739fc-a556-426c-ad90-92715d858942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15607532-0715-4b5e-a95c-1e90e9a06d30', 'volume_name': 'volume-15607532-0715-4b5e-a95c-1e90e9a06d30', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9421db6-47ff-487b-a4ea-00b350164f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9421db6-47ff-487b-a4ea-00b350164f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0bdaac6-6f05-46c5-a982-50501d0baab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:53 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Volume 15607532-0715-4b5e-a95c-1e90e9a06d30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15607532-0715-4b5e-a95c-1e90e9a06d30', 'volume_size': 1} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:53 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-752fc120-a692-4601-81b4-8535ee48948f 1073741824" returned: 0 in 1.048s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8469bc5a-f9f3-40e4-a5a2-248b230cac99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3e2caa2b-0689-4c36-8acd-23877eef0188', 'volume_name': 'volume-3e2caa2b-0689-4c36-8acd-23877eef0188', 'volume_size': 1, 'image_id': 'bdec91ed-5d2d-485e-94b1-3b6ba244a579', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdec91ed-5d2d-485e-94b1-3b6ba244a579', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '966a231929c5157d408a7a324324edac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ecafdbf8b801493dbaf82f0d488aedcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '218f302ae5682605a256abda04ada323c3303c9f0be1f45cb42224e9fc1633634e14401ee31a4f14ed448d791a0c6de449fb32fd7397ed9f0ba2462a7834a739', 'id': 'bdec91ed-5d2d-485e-94b1-3b6ba244a579', 'created_at': datetime.datetime(2026, 7, 10, 2, 59, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 59, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdec91ed-5d2d-485e-94b1-3b6ba244a579/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d445466-976d-498e-9086-e4badd149c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d445466-976d-498e-9086-e4badd149c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc8bf032-48d1-4341-85a9-7b12f3dde922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:53 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Volume 3e2caa2b-0689-4c36-8acd-23877eef0188: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3e2caa2b-0689-4c36-8acd-23877eef0188', 'volume_size': 1, 'image_id': 'bdec91ed-5d2d-485e-94b1-3b6ba244a579', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdec91ed-5d2d-485e-94b1-3b6ba244a579', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '966a231929c5157d408a7a324324edac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ecafdbf8b801493dbaf82f0d488aedcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '218f302ae5682605a256abda04ada323c3303c9f0be1f45cb42224e9fc1633634e14401ee31a4f14ed448d791a0c6de449fb32fd7397ed9f0ba2462a7834a739', 'id': 'bdec91ed-5d2d-485e-94b1-3b6ba244a579', 'created_at': datetime.datetime(2026, 7, 10, 2, 59, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 59, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdec91ed-5d2d-485e-94b1-3b6ba244a579/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Trying to clone 3e2caa2b-0689-4c36-8acd-23877eef0188 from image bdec91ed-5d2d-485e-94b1-3b6ba244a579 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bdec91ed-5d2d-485e-94b1-3b6ba244a579', 'metadata': {}}]). {{(pid=87359) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-752fc120-a692-4601-81b4-8535ee48948f {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:53 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-752fc120-a692-4601-81b4-8535ee48948f Jul 10 04:59:53 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Jul 10 04:59:53 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Image download 0.00 MB at 0.00 MB/s Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f98fe7-45c7-4d13-a811-f5b0ce6e2036]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Flow 'volume_create_manager' (b39e4b36-5cba-41c0-9de7-1a6a6d4cc4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:53 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD Jul 10 04:59:53 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2a3df7-972e-47ed-bf86-b40478b80318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2a3df7-972e-47ed-bf86-b40478b80318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2104437034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df198d7b-7d14-49ca-965b-12024d406ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac07514631cd4ef592ba902b55f69ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:54Z,use_quota=True,user_id='05fa1814feab491fba0b7d781fa4313a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97116af9-de99-4b82-8c62-4a81c4b12086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97116af9-de99-4b82-8c62-4a81c4b12086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce12b79-cf6a-47e9-9022-70e8b71156e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce12b79-cf6a-47e9-9022-70e8b71156e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df198d7b-7d14-49ca-965b-12024d406ff4', 'volume_name': 'volume-df198d7b-7d14-49ca-965b-12024d406ff4', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ec289ca-63e9-4557-b8ac-baae820f943c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ec289ca-63e9-4557-b8ac-baae820f943c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31892be9-d6a0-4df2-9ec6-9f47256e539d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:53 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Volume df198d7b-7d14-49ca-965b-12024d406ff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df198d7b-7d14-49ca-965b-12024d406ff4', 'volume_size': 1} Jul 10 04:59:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:54 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-752fc120-a692-4601-81b4-8535ee48948f" returned: 0 in 0.730s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:59:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:59:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.459s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-136707012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44cd8e81-03f2-46fd-a63d-10539ff66a09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f1c4a47713c46b08df7d60f7caf062f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:50Z,use_quota=True,user_id='5fb974c7c8844199af122f5efa95f67c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:59:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Creating volume 44cd8e81-03f2-46fd-a63d-10539ff66a09 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:59:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:59:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:59:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:59:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:59:54 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:59:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f99011ff-2e82-4021-962d-9c39dac393d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-752fc120-a692-4601-81b4-8535ee48948f', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:54 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 1073741824 Jul 10 04:59:54 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36d9d3b-63d9-4a4d-acff-c59d08ed3963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:54 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Volume volume-752fc120-a692-4601-81b4-8535ee48948f (752fc120-a692-4601-81b4-8535ee48948f): created successfully Jul 10 04:59:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36d9d3b-63d9-4a4d-acff-c59d08ed3963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Flow 'volume_create_manager' (e3bb07a7-af05-4c72-a951-83657514b63e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:54 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-f6e12cc8-38cf-43a0-ab2b-15396c0f340c tempest-CreateVolumesFromImageTest-1498478426 None] Created volume successfully. Jul 10 04:59:54 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:54 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD Jul 10 04:59:54 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:55 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 1073741824" returned: 0 in 0.866s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:55 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD" returned: 1 in 0.722s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Temporary image bdec91ed-5d2d-485e-94b1-3b6ba244a579 is fetched for user 3bbe856181e24be38140b5af9aae28de. {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Jul 10 04:59:55 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 Jul 10 04:59:55 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[63144f78-ca7e-4f5f-9485-b74523f5a822]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:55 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD Jul 10 04:59:55 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:55 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09" returned: 0 in 0.664s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.749s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-345093193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47038865-cfd5-425f-a86e-31a20428b429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a675eb8f724783aee0911d575ed5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:50Z,use_quota=True,user_id='ea5b8a11bd924ef9b49ca80827210129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Creating volume 47038865-cfd5-425f-a86e-31a20428b429 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:59:55 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-47038865-cfd5-425f-a86e-31a20428b429 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:55 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-47038865-cfd5-425f-a86e-31a20428b429 1073741824 Jul 10 04:59:55 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54ee734-d40e-4408-aadc-8f489badf5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44cd8e81-03f2-46fd-a63d-10539ff66a09', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1d9ef5-2678-48f7-ad7b-867b76ef31ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:55 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Volume volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 (44cd8e81-03f2-46fd-a63d-10539ff66a09): created successfully Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1d9ef5-2678-48f7-ad7b-867b76ef31ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:55 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Flow 'volume_create_manager' (581e436d-1267-422d-9409-1b615a0c2e8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:56 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-60fe2b63-f987-400a-8a69-8da229d14fa9 tempest-VolumeDependencyTests-111182761 None] Created volume successfully. Jul 10 04:59:56 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD" returned: 0 in 0.746s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:56 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD Jul 10 04:59:56 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:56 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-47038865-cfd5-425f-a86e-31a20428b429 1073741824" returned: 0 in 0.874s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:56 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD" returned: 1 in 0.743s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:59:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-47038865-cfd5-425f-a86e-31a20428b429 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:56 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-47038865-cfd5-425f-a86e-31a20428b429 Jul 10 04:59:56 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7dd68f90-0d91-42b2-9135-b32833a37f9a tempest-VolumeDependencyTests-111182761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:57 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-47038865-cfd5-425f-a86e-31a20428b429" returned: 0 in 0.636s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:57 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:59:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:59:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.100s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:57 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1388878541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365de1be-98fb-4cce-b928-1327eeed087f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a675eb8f724783aee0911d575ed5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:50Z,use_quota=True,user_id='ea5b8a11bd924ef9b49ca80827210129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:59:57 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Creating volume 365de1be-98fb-4cce-b928-1327eeed087f {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:59:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:57 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:59:57 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:59:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:59:57 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:59:57 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:59:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365de1be-98fb-4cce-b928-1327eeed087f 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:57 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e74fe02-0871-417b-9cdc-5946762a18aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47038865-cfd5-425f-a86e-31a20428b429', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:57 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365de1be-98fb-4cce-b928-1327eeed087f 1073741824 Jul 10 04:59:57 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d134494-a0ce-4936-8bdc-12efab7a4768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:57 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:57 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Volume volume-47038865-cfd5-425f-a86e-31a20428b429 (47038865-cfd5-425f-a86e-31a20428b429): created successfully Jul 10 04:59:57 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d134494-a0ce-4936-8bdc-12efab7a4768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:57 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Flow 'volume_create_manager' (21e9c29d-75cc-44ac-b833-cc46417bb98f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:57 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a0c59f4e-a6c0-47a2-924d-ea1f62a3b2e8 tempest-CreateVolumesFromImageTest-1498478426 None] Created volume successfully. Jul 10 04:59:58 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365de1be-98fb-4cce-b928-1327eeed087f 1073741824" returned: 0 in 0.826s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365de1be-98fb-4cce-b928-1327eeed087f {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:58 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365de1be-98fb-4cce-b928-1327eeed087f Jul 10 04:59:58 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:58 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365de1be-98fb-4cce-b928-1327eeed087f" returned: 0 in 0.639s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:59:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:59:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.479s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-487051416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b20a39-8630-4bc6-8e16-ded978b86884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a675eb8f724783aee0911d575ed5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:50Z,use_quota=True,user_id='ea5b8a11bd924ef9b49ca80827210129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:59:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Creating volume 00b20a39-8630-4bc6-8e16-ded978b86884 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:59:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:59:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:59:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:59:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:59:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:59:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:59:58 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 04:59:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-00b20a39-8630-4bc6-8e16-ded978b86884 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:59 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-00b20a39-8630-4bc6-8e16-ded978b86884 1073741824 Jul 10 04:59:59 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:59:59 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac928b8-82f9-4e58-af88-d0917bef18ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-365de1be-98fb-4cce-b928-1327eeed087f', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:59 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac9d956-29d9-4ac9-a313-8c6df7488115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:59:59 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Volume volume-365de1be-98fb-4cce-b928-1327eeed087f (365de1be-98fb-4cce-b928-1327eeed087f): created successfully Jul 10 04:59:59 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac9d956-29d9-4ac9-a313-8c6df7488115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:59:59 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Flow 'volume_create_manager' (3fd56b0d-327a-47df-9ea0-e2eba5495088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:59:59 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d935b8da-949e-42ee-8193-962b4d5d7553 tempest-CreateVolumesFromImageTest-1498478426 None] Created volume successfully. Jul 10 04:59:59 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Jul 10 04:59:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-00b20a39-8630-4bc6-8e16-ded978b86884 1073741824" returned: 0 in 0.799s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:59:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-00b20a39-8630-4bc6-8e16-ded978b86884 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:59:59 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-00b20a39-8630-4bc6-8e16-ded978b86884 Jul 10 04:59:59 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:00 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-00b20a39-8630-4bc6-8e16-ded978b86884" returned: 0 in 0.669s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:00:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.411s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1870264640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bddc988f-0575-40d7-b89e-08df98271d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac07514631cd4ef592ba902b55f69ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:52Z,use_quota=True,user_id='05fa1814feab491fba0b7d781fa4313a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:00:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Creating volume bddc988f-0575-40d7-b89e-08df98271d05 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:00:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:00:00 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:00:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bddc988f-0575-40d7-b89e-08df98271d05 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:00 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bddc988f-0575-40d7-b89e-08df98271d05 1073741824 Jul 10 05:00:00 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:00 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ae0211-b88d-48b7-83bd-041833b5b446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00b20a39-8630-4bc6-8e16-ded978b86884', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:00 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98ec74e-0c32-45cf-beff-5332e81bc0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:00 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Volume volume-00b20a39-8630-4bc6-8e16-ded978b86884 (00b20a39-8630-4bc6-8e16-ded978b86884): created successfully Jul 10 05:00:00 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98ec74e-0c32-45cf-beff-5332e81bc0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:00 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Flow 'volume_create_manager' (f40a71b2-b602-45d0-b4b4-27e13bc69541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:00 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-db540e32-cbba-4911-a486-cd9fbd78f163 tempest-CreateVolumesFromImageTest-1498478426 None] Created volume successfully. Jul 10 05:00:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-28e48c5d-5c2c-48e7-8f6c-55aa83295a5a tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "cinder-00b20a39-8630-4bc6-8e16-ded978b86884-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-28e48c5d-5c2c-48e7-8f6c-55aa83295a5a tempest-CreateVolumesFromImageTest-1498478426 None] Lock "cinder-00b20a39-8630-4bc6-8e16-ded978b86884-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-28e48c5d-5c2c-48e7-8f6c-55aa83295a5a tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "cinder-quobyte-00b20a39-8630-4bc6-8e16-ded978b86884" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-28e48c5d-5c2c-48e7-8f6c-55aa83295a5a tempest-CreateVolumesFromImageTest-1498478426 None] Lock "cinder-quobyte-00b20a39-8630-4bc6-8e16-ded978b86884" acquired by "delete_volume" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:01 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[24db5cd9-26ab-4193-b1b3-2dfb2a270ebe]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-28e48c5d-5c2c-48e7-8f6c-55aa83295a5a tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-00b20a39-8630-4bc6-8e16-ded978b86884 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:01 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-00b20a39-8630-4bc6-8e16-ded978b86884 Jul 10 05:00:01 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:01 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bddc988f-0575-40d7-b89e-08df98271d05 1073741824" returned: 0 in 0.878s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bddc988f-0575-40d7-b89e-08df98271d05 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:01 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bddc988f-0575-40d7-b89e-08df98271d05 Jul 10 05:00:01 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:01 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-28e48c5d-5c2c-48e7-8f6c-55aa83295a5a tempest-CreateVolumesFromImageTest-1498478426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-00b20a39-8630-4bc6-8e16-ded978b86884" returned: 0 in 0.807s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-28e48c5d-5c2c-48e7-8f6c-55aa83295a5a tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-00b20a39-8630-4bc6-8e16-ded978b86884 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:02 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-00b20a39-8630-4bc6-8e16-ded978b86884 Jul 10 05:00:02 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:02 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bddc988f-0575-40d7-b89e-08df98271d05" returned: 0 in 0.641s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.501s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-364987223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68eaae9b-3977-4666-b3d9-e700cb48c586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac07514631cd4ef592ba902b55f69ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:52Z,use_quota=True,user_id='05fa1814feab491fba0b7d781fa4313a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Creating volume 68eaae9b-3977-4666-b3d9-e700cb48c586 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:00:02 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68eaae9b-3977-4666-b3d9-e700cb48c586 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:02 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68eaae9b-3977-4666-b3d9-e700cb48c586 1073741824 Jul 10 05:00:02 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6764557b-5b1f-4c15-8c46-58edd23dd2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bddc988f-0575-40d7-b89e-08df98271d05', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127fb845-43e1-4b4c-911d-7ed46457ab42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:02 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Volume volume-bddc988f-0575-40d7-b89e-08df98271d05 (bddc988f-0575-40d7-b89e-08df98271d05): created successfully Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127fb845-43e1-4b4c-911d-7ed46457ab42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Flow 'volume_create_manager' (500733b1-15fc-4d9f-bab7-1c3fe975b027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:02 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-79b8913d-5568-4bac-b924-2dcf53ac9b91 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Created volume successfully. Jul 10 05:00:02 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-28e48c5d-5c2c-48e7-8f6c-55aa83295a5a tempest-CreateVolumesFromImageTest-1498478426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-00b20a39-8630-4bc6-8e16-ded978b86884" returned: 0 in 0.675s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-28e48c5d-5c2c-48e7-8f6c-55aa83295a5a tempest-CreateVolumesFromImageTest-1498478426 None] Lock "cinder-quobyte-00b20a39-8630-4bc6-8e16-ded978b86884" released by "delete_volume" :: held 1.522s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-28e48c5d-5c2c-48e7-8f6c-55aa83295a5a tempest-CreateVolumesFromImageTest-1498478426 None] Created reservations ['3101f7f1-8362-46ac-9d54-03a13f9aa332', '03a3cee9-2d40-499e-a44e-ec3bccf73fd9', '58679cd9-3f32-48b8-bf5c-5a43f6878afa', '679dc6a4-003f-4796-bfe0-8dd77c596975'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-28e48c5d-5c2c-48e7-8f6c-55aa83295a5a tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-28e48c5d-5c2c-48e7-8f6c-55aa83295a5a tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-28e48c5d-5c2c-48e7-8f6c-55aa83295a5a tempest-CreateVolumesFromImageTest-1498478426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-28e48c5d-5c2c-48e7-8f6c-55aa83295a5a tempest-CreateVolumesFromImageTest-1498478426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-28e48c5d-5c2c-48e7-8f6c-55aa83295a5a tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-28e48c5d-5c2c-48e7-8f6c-55aa83295a5a tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:02 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:00:02 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:02 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68eaae9b-3977-4666-b3d9-e700cb48c586 1073741824" returned: 0 in 0.868s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68eaae9b-3977-4666-b3d9-e700cb48c586 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:02 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68eaae9b-3977-4666-b3d9-e700cb48c586 Jul 10 05:00:02 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6d50dbad-4707-4e13-850f-04fb48a87a91 tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "cinder-365de1be-98fb-4cce-b928-1327eeed087f-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6d50dbad-4707-4e13-850f-04fb48a87a91 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "cinder-365de1be-98fb-4cce-b928-1327eeed087f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6d50dbad-4707-4e13-850f-04fb48a87a91 tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "cinder-quobyte-365de1be-98fb-4cce-b928-1327eeed087f" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6d50dbad-4707-4e13-850f-04fb48a87a91 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "cinder-quobyte-365de1be-98fb-4cce-b928-1327eeed087f" acquired by "delete_volume" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8a1d55-293f-4968-86c0-e32d05cbb0bc]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6d50dbad-4707-4e13-850f-04fb48a87a91 tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365de1be-98fb-4cce-b928-1327eeed087f {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:03 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-28e48c5d-5c2c-48e7-8f6c-55aa83295a5a tempest-CreateVolumesFromImageTest-1498478426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.766s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-28e48c5d-5c2c-48e7-8f6c-55aa83295a5a tempest-CreateVolumesFromImageTest-1498478426 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:00:03 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-28e48c5d-5c2c-48e7-8f6c-55aa83295a5a tempest-CreateVolumesFromImageTest-1498478426 None] Deleted volume successfully. Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-28e48c5d-5c2c-48e7-8f6c-55aa83295a5a tempest-CreateVolumesFromImageTest-1498478426 None] Lock "cinder-00b20a39-8630-4bc6-8e16-ded978b86884-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:03 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68eaae9b-3977-4666-b3d9-e700cb48c586" returned: 0 in 0.660s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.307s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-361440548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e74248a-8516-47a5-a170-e3daf013e556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac07514631cd4ef592ba902b55f69ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:53Z,use_quota=True,user_id='05fa1814feab491fba0b7d781fa4313a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Creating volume 4e74248a-8516-47a5-a170-e3daf013e556 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:03 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365de1be-98fb-4cce-b928-1327eeed087f Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:03 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:00:03 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4e74248a-8516-47a5-a170-e3daf013e556 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:03 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4e74248a-8516-47a5-a170-e3daf013e556 1073741824 Jul 10 05:00:03 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf43f68-1fe1-456f-be51-d99eac8e13a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68eaae9b-3977-4666-b3d9-e700cb48c586', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a8f9bf-f59d-4e18-a387-bc4d77bad685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:03 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Volume volume-68eaae9b-3977-4666-b3d9-e700cb48c586 (68eaae9b-3977-4666-b3d9-e700cb48c586): created successfully Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a8f9bf-f59d-4e18-a387-bc4d77bad685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:03 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Flow 'volume_create_manager' (4f561c4c-1ae3-411f-8e76-b3cf3947f461) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:03 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ae87317a-d345-43cc-9a8f-c3ff3cf7422a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Created volume successfully. Jul 10 05:00:04 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6d50dbad-4707-4e13-850f-04fb48a87a91 tempest-CreateVolumesFromImageTest-1498478426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365de1be-98fb-4cce-b928-1327eeed087f" returned: 0 in 0.816s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6d50dbad-4707-4e13-850f-04fb48a87a91 tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365de1be-98fb-4cce-b928-1327eeed087f {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:04 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365de1be-98fb-4cce-b928-1327eeed087f Jul 10 05:00:04 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:04 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4e74248a-8516-47a5-a170-e3daf013e556 1073741824" returned: 0 in 0.838s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4e74248a-8516-47a5-a170-e3daf013e556 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:04 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4e74248a-8516-47a5-a170-e3daf013e556 Jul 10 05:00:04 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:04 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6d50dbad-4707-4e13-850f-04fb48a87a91 tempest-CreateVolumesFromImageTest-1498478426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-365de1be-98fb-4cce-b928-1327eeed087f" returned: 0 in 0.671s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6d50dbad-4707-4e13-850f-04fb48a87a91 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "cinder-quobyte-365de1be-98fb-4cce-b928-1327eeed087f" released by "delete_volume" :: held 1.542s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-6d50dbad-4707-4e13-850f-04fb48a87a91 tempest-CreateVolumesFromImageTest-1498478426 None] Created reservations ['54d8e4ab-7eff-4480-9b48-1d61074b36ab', '617126ba-fd1a-4b3a-b717-067f154316b6', '9dc6dabd-dd8d-4c51-874c-21f043248c7d', '5c180e2c-cfb5-4b1c-8c3a-11aa11f5c3ff'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6d50dbad-4707-4e13-850f-04fb48a87a91 tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6d50dbad-4707-4e13-850f-04fb48a87a91 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6d50dbad-4707-4e13-850f-04fb48a87a91 tempest-CreateVolumesFromImageTest-1498478426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6d50dbad-4707-4e13-850f-04fb48a87a91 tempest-CreateVolumesFromImageTest-1498478426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6d50dbad-4707-4e13-850f-04fb48a87a91 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6d50dbad-4707-4e13-850f-04fb48a87a91 tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:05 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4e74248a-8516-47a5-a170-e3daf013e556" returned: 0 in 0.635s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.686s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-478561398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15607532-0715-4b5e-a95c-1e90e9a06d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac07514631cd4ef592ba902b55f69ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:53Z,use_quota=True,user_id='05fa1814feab491fba0b7d781fa4313a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Creating volume 15607532-0715-4b5e-a95c-1e90e9a06d30 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:05 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:05 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:00:05 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-15607532-0715-4b5e-a95c-1e90e9a06d30 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b7e4050-4562-465d-ab7e-85d67145e8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e74248a-8516-47a5-a170-e3daf013e556', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:05 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-15607532-0715-4b5e-a95c-1e90e9a06d30 1073741824 Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97247b39-3340-4357-a09f-c33fb14f2fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:05 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:05 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Volume volume-4e74248a-8516-47a5-a170-e3daf013e556 (4e74248a-8516-47a5-a170-e3daf013e556): created successfully Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97247b39-3340-4357-a09f-c33fb14f2fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Flow 'volume_create_manager' (7697c362-48e4-4119-a128-bed5c1d0ab17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:05 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-b04f36fc-74b7-4261-9a44-e1d0efd6f9c6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Created volume successfully. Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ee7a3b4c-9ccd-4320-8dce-2e0ec46c4a00 tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "cinder-47038865-cfd5-425f-a86e-31a20428b429-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ee7a3b4c-9ccd-4320-8dce-2e0ec46c4a00 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "cinder-47038865-cfd5-425f-a86e-31a20428b429-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:05 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ee7a3b4c-9ccd-4320-8dce-2e0ec46c4a00 tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "cinder-quobyte-47038865-cfd5-425f-a86e-31a20428b429" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6d50dbad-4707-4e13-850f-04fb48a87a91 tempest-CreateVolumesFromImageTest-1498478426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.654s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-6d50dbad-4707-4e13-850f-04fb48a87a91 tempest-CreateVolumesFromImageTest-1498478426 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:00:05 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-6d50dbad-4707-4e13-850f-04fb48a87a91 tempest-CreateVolumesFromImageTest-1498478426 None] Deleted volume successfully. Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ee7a3b4c-9ccd-4320-8dce-2e0ec46c4a00 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "cinder-quobyte-47038865-cfd5-425f-a86e-31a20428b429" acquired by "delete_volume" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6d50dbad-4707-4e13-850f-04fb48a87a91 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "cinder-365de1be-98fb-4cce-b928-1327eeed087f-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[eded5f30-0459-42ff-85c6-5b68a2352436]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee7a3b4c-9ccd-4320-8dce-2e0ec46c4a00 tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-47038865-cfd5-425f-a86e-31a20428b429 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:05 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-47038865-cfd5-425f-a86e-31a20428b429 Jul 10 05:00:05 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:06 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-15607532-0715-4b5e-a95c-1e90e9a06d30 1073741824" returned: 0 in 0.888s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-15607532-0715-4b5e-a95c-1e90e9a06d30 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:06 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-15607532-0715-4b5e-a95c-1e90e9a06d30 Jul 10 05:00:06 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:06 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee7a3b4c-9ccd-4320-8dce-2e0ec46c4a00 tempest-CreateVolumesFromImageTest-1498478426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-47038865-cfd5-425f-a86e-31a20428b429" returned: 0 in 0.751s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee7a3b4c-9ccd-4320-8dce-2e0ec46c4a00 tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-47038865-cfd5-425f-a86e-31a20428b429 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:06 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-47038865-cfd5-425f-a86e-31a20428b429 Jul 10 05:00:06 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:06 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-15607532-0715-4b5e-a95c-1e90e9a06d30" returned: 0 in 0.658s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:00:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.792s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2104437034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df198d7b-7d14-49ca-965b-12024d406ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac07514631cd4ef592ba902b55f69ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:54Z,use_quota=True,user_id='05fa1814feab491fba0b7d781fa4313a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:00:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Creating volume df198d7b-7d14-49ca-965b-12024d406ff4 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:00:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:00:06 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:00:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-df198d7b-7d14-49ca-965b-12024d406ff4 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:06 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-df198d7b-7d14-49ca-965b-12024d406ff4 1073741824 Jul 10 05:00:06 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0bdaac6-6f05-46c5-a982-50501d0baab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15607532-0715-4b5e-a95c-1e90e9a06d30', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ffa2a5-46f2-44c1-8f16-7a04bc9ebaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:06 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Volume volume-15607532-0715-4b5e-a95c-1e90e9a06d30 (15607532-0715-4b5e-a95c-1e90e9a06d30): created successfully Jul 10 05:00:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ffa2a5-46f2-44c1-8f16-7a04bc9ebaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Flow 'volume_create_manager' (acb98eb1-e84b-46ca-bb16-bb6ad68101e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:06 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-84614822-572f-492a-8170-eb23705dd47a tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Created volume successfully. Jul 10 05:00:07 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee7a3b4c-9ccd-4320-8dce-2e0ec46c4a00 tempest-CreateVolumesFromImageTest-1498478426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-47038865-cfd5-425f-a86e-31a20428b429" returned: 0 in 0.627s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:07 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ee7a3b4c-9ccd-4320-8dce-2e0ec46c4a00 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "cinder-quobyte-47038865-cfd5-425f-a86e-31a20428b429" released by "delete_volume" :: held 1.422s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:07 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-ee7a3b4c-9ccd-4320-8dce-2e0ec46c4a00 tempest-CreateVolumesFromImageTest-1498478426 None] Created reservations ['506b6476-95a1-4f0b-a1e9-2bbd1012c9a1', '04bf5f13-fc2c-4717-a286-504543cac096', 'deb19878-1728-45a6-8b4d-1b6d5fdb061e', '6a004d00-1d59-4429-a538-9dca4066da3d'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:00:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ee7a3b4c-9ccd-4320-8dce-2e0ec46c4a00 tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ee7a3b4c-9ccd-4320-8dce-2e0ec46c4a00 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ee7a3b4c-9ccd-4320-8dce-2e0ec46c4a00 tempest-CreateVolumesFromImageTest-1498478426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ee7a3b4c-9ccd-4320-8dce-2e0ec46c4a00 tempest-CreateVolumesFromImageTest-1498478426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ee7a3b4c-9ccd-4320-8dce-2e0ec46c4a00 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee7a3b4c-9ccd-4320-8dce-2e0ec46c4a00 tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:07 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:00:07 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:07 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-df198d7b-7d14-49ca-965b-12024d406ff4 1073741824" returned: 0 in 0.850s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-df198d7b-7d14-49ca-965b-12024d406ff4 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:07 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-df198d7b-7d14-49ca-965b-12024d406ff4 Jul 10 05:00:07 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:07 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a9eb216c-123d-4fab-b38f-5ba39134200f tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "cinder-752fc120-a692-4601-81b4-8535ee48948f-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:07 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a9eb216c-123d-4fab-b38f-5ba39134200f tempest-CreateVolumesFromImageTest-1498478426 None] Lock "cinder-752fc120-a692-4601-81b4-8535ee48948f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a9eb216c-123d-4fab-b38f-5ba39134200f tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "cinder-quobyte-752fc120-a692-4601-81b4-8535ee48948f" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a9eb216c-123d-4fab-b38f-5ba39134200f tempest-CreateVolumesFromImageTest-1498478426 None] Lock "cinder-quobyte-752fc120-a692-4601-81b4-8535ee48948f" acquired by "delete_volume" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1de980e-3160-4026-9ca5-ea1414493e87]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a9eb216c-123d-4fab-b38f-5ba39134200f tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-752fc120-a692-4601-81b4-8535ee48948f {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:08 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee7a3b4c-9ccd-4320-8dce-2e0ec46c4a00 tempest-CreateVolumesFromImageTest-1498478426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.725s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-ee7a3b4c-9ccd-4320-8dce-2e0ec46c4a00 tempest-CreateVolumesFromImageTest-1498478426 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:00:08 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ee7a3b4c-9ccd-4320-8dce-2e0ec46c4a00 tempest-CreateVolumesFromImageTest-1498478426 None] Deleted volume successfully. Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ee7a3b4c-9ccd-4320-8dce-2e0ec46c4a00 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "cinder-47038865-cfd5-425f-a86e-31a20428b429-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:08 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-752fc120-a692-4601-81b4-8535ee48948f Jul 10 05:00:08 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:08 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-df198d7b-7d14-49ca-965b-12024d406ff4" returned: 0 in 0.663s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.522s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2caa2b-0689-4c36-8acd-23877eef0188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecafdbf8b801493dbaf82f0d488aedcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:59:53Z,use_quota=True,user_id='3bbe856181e24be38140b5af9aae28de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce976c7e-a128-44c2-b56d-f00f18eb7165),volume_type_id=ce976c7e-a128-44c2-b56d-f00f18eb7165)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Creating volume 3e2caa2b-0689-4c36-8acd-23877eef0188 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:00:08 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31892be9-d6a0-4df2-9ec6-9f47256e539d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df198d7b-7d14-49ca-965b-12024d406ff4', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:08 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188 1073741824 Jul 10 05:00:08 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2dac67-fc23-4d09-a269-c5a67e0dbb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:08 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Volume volume-df198d7b-7d14-49ca-965b-12024d406ff4 (df198d7b-7d14-49ca-965b-12024d406ff4): created successfully Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2dac67-fc23-4d09-a269-c5a67e0dbb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Flow 'volume_create_manager' (b39e4b36-5cba-41c0-9de7-1a6a6d4cc4ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:08 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c6916e24-6226-4671-a4d0-98f05eab1243 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Created volume successfully. Jul 10 05:00:08 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a9eb216c-123d-4fab-b38f-5ba39134200f tempest-CreateVolumesFromImageTest-1498478426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-752fc120-a692-4601-81b4-8535ee48948f" returned: 0 in 0.778s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a9eb216c-123d-4fab-b38f-5ba39134200f tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-752fc120-a692-4601-81b4-8535ee48948f {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:08 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-752fc120-a692-4601-81b4-8535ee48948f Jul 10 05:00:08 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5710cdd1-66af-421d-a818-9ee0b118ba85 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "cinder-df198d7b-7d14-49ca-965b-12024d406ff4-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5710cdd1-66af-421d-a818-9ee0b118ba85 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-df198d7b-7d14-49ca-965b-12024d406ff4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:09 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5710cdd1-66af-421d-a818-9ee0b118ba85 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "cinder-quobyte-df198d7b-7d14-49ca-965b-12024d406ff4" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:09 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5710cdd1-66af-421d-a818-9ee0b118ba85 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-quobyte-df198d7b-7d14-49ca-965b-12024d406ff4" acquired by "delete_volume" :: waited 0.023s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:09 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b4fd75-495d-4083-8722-dae10a9fb79e]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5710cdd1-66af-421d-a818-9ee0b118ba85 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-df198d7b-7d14-49ca-965b-12024d406ff4 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:09 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-df198d7b-7d14-49ca-965b-12024d406ff4 Jul 10 05:00:09 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:09 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188 1073741824" returned: 0 in 0.938s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:09 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188 Jul 10 05:00:09 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:09 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a9eb216c-123d-4fab-b38f-5ba39134200f tempest-CreateVolumesFromImageTest-1498478426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-752fc120-a692-4601-81b4-8535ee48948f" returned: 0 in 0.731s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:09 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a9eb216c-123d-4fab-b38f-5ba39134200f tempest-CreateVolumesFromImageTest-1498478426 None] Lock "cinder-quobyte-752fc120-a692-4601-81b4-8535ee48948f" released by "delete_volume" :: held 1.560s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:09 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-a9eb216c-123d-4fab-b38f-5ba39134200f tempest-CreateVolumesFromImageTest-1498478426 None] Created reservations ['fc372bf9-8513-4f80-8853-56385c380420', '6df72193-d803-40a6-8315-059af32ac411', 'ede00370-597a-47f2-9480-58711c68b0c2', '2f34c6af-c172-4bdb-8070-d31eb486713b'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:00:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a9eb216c-123d-4fab-b38f-5ba39134200f tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a9eb216c-123d-4fab-b38f-5ba39134200f tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a9eb216c-123d-4fab-b38f-5ba39134200f tempest-CreateVolumesFromImageTest-1498478426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a9eb216c-123d-4fab-b38f-5ba39134200f tempest-CreateVolumesFromImageTest-1498478426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a9eb216c-123d-4fab-b38f-5ba39134200f tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a9eb216c-123d-4fab-b38f-5ba39134200f tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:09 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:00:09 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:10 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5710cdd1-66af-421d-a818-9ee0b118ba85 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-df198d7b-7d14-49ca-965b-12024d406ff4" returned: 0 in 0.922s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5710cdd1-66af-421d-a818-9ee0b118ba85 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-df198d7b-7d14-49ca-965b-12024d406ff4 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:10 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-df198d7b-7d14-49ca-965b-12024d406ff4 Jul 10 05:00:10 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:10 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188" returned: 0 in 0.723s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7dd68f90-0d91-42b2-9135-b32833a37f9a tempest-VolumeDependencyTests-111182761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.806s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-7dd68f90-0d91-42b2-9135-b32833a37f9a tempest-VolumeDependencyTests-111182761 None] Creating offline snapshot b964a98d-a502-41d4-9ff2-a3eaf042ef84 of volume 44cd8e81-03f2-46fd-a63d-10539ff66a09 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[101471f3-7f24-45f3-b80f-6693b18d048e]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7dd68f90-0d91-42b2-9135-b32833a37f9a tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Attempting download of bdec91ed-5d2d-485e-94b1-3b6ba244a579 ((None, [{'url': 'file:///opt/stack/data/glance/images/bdec91ed-5d2d-485e-94b1-3b6ba244a579', 'metadata': {}}])) to volume 3e2caa2b-0689-4c36-8acd-23877eef0188. {{(pid=87359) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b4a30a-8ff9-42a2-83c5-82eeda93832a]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdec91ed-5d2d-485e-94b1-3b6ba244a579_aa5002f2 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:10 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 Jul 10 05:00:10 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6bde4519-42e7-4cc6-8b3b-3dd396954259 tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "cinder-201c3fa7-9bc1-4a60-9dc8-6380f5de30ef-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6bde4519-42e7-4cc6-8b3b-3dd396954259 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "cinder-201c3fa7-9bc1-4a60-9dc8-6380f5de30ef-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6bde4519-42e7-4cc6-8b3b-3dd396954259 tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "cinder-quobyte-201c3fa7-9bc1-4a60-9dc8-6380f5de30ef" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6bde4519-42e7-4cc6-8b3b-3dd396954259 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "cinder-quobyte-201c3fa7-9bc1-4a60-9dc8-6380f5de30ef" acquired by "delete_volume" :: waited 0.026s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:10 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdec91ed-5d2d-485e-94b1-3b6ba244a579_aa5002f2 Jul 10 05:00:10 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7980c24-5b80-494f-b2ec-cf4e812a3938]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6bde4519-42e7-4cc6-8b3b-3dd396954259 tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-201c3fa7-9bc1-4a60-9dc8-6380f5de30ef {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:10 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-201c3fa7-9bc1-4a60-9dc8-6380f5de30ef Jul 10 05:00:10 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:10 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a9eb216c-123d-4fab-b38f-5ba39134200f tempest-CreateVolumesFromImageTest-1498478426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.966s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-a9eb216c-123d-4fab-b38f-5ba39134200f tempest-CreateVolumesFromImageTest-1498478426 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:00:10 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a9eb216c-123d-4fab-b38f-5ba39134200f tempest-CreateVolumesFromImageTest-1498478426 None] Deleted volume successfully. Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a9eb216c-123d-4fab-b38f-5ba39134200f tempest-CreateVolumesFromImageTest-1498478426 None] Lock "cinder-752fc120-a692-4601-81b4-8535ee48948f-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:10 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5710cdd1-66af-421d-a818-9ee0b118ba85 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-df198d7b-7d14-49ca-965b-12024d406ff4" returned: 0 in 0.953s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5710cdd1-66af-421d-a818-9ee0b118ba85 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-quobyte-df198d7b-7d14-49ca-965b-12024d406ff4" released by "delete_volume" :: held 1.923s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:11 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-5710cdd1-66af-421d-a818-9ee0b118ba85 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Created reservations ['7de6a12e-6560-4b84-83ca-c493bb642f10', 'c7d9e348-e3b3-45b9-b1a4-acb2ae6c945a', 'f1315d4e-0fc8-44d9-ba53-02fef41a331a', '32699eee-e36e-4def-bc4f-ffd8101fa62b'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:00:11 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7dd68f90-0d91-42b2-9135-b32833a37f9a tempest-VolumeDependencyTests-111182761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09" returned: 0 in 0.994s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7dd68f90-0d91-42b2-9135-b32833a37f9a tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5710cdd1-66af-421d-a818-9ee0b118ba85 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5710cdd1-66af-421d-a818-9ee0b118ba85 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:11 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5710cdd1-66af-421d-a818-9ee0b118ba85 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:11 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84 1G Jul 10 05:00:11 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:11 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5710cdd1-66af-421d-a818-9ee0b118ba85 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5710cdd1-66af-421d-a818-9ee0b118ba85 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5710cdd1-66af-421d-a818-9ee0b118ba85 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:11 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:00:11 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:11 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdec91ed-5d2d-485e-94b1-3b6ba244a579_aa5002f2" returned: 0 in 1.055s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdec91ed-5d2d-485e-94b1-3b6ba244a579_aa5002f2 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:11 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-809ef0d7-7eae-493f-8de8-01d37697a602 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "cinder-15607532-0715-4b5e-a95c-1e90e9a06d30-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:11 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-809ef0d7-7eae-493f-8de8-01d37697a602 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-15607532-0715-4b5e-a95c-1e90e9a06d30-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:11 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-809ef0d7-7eae-493f-8de8-01d37697a602 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "cinder-quobyte-15607532-0715-4b5e-a95c-1e90e9a06d30" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:11 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdec91ed-5d2d-485e-94b1-3b6ba244a579_aa5002f2 Jul 10 05:00:11 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:11 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-809ef0d7-7eae-493f-8de8-01d37697a602 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-quobyte-15607532-0715-4b5e-a95c-1e90e9a06d30" acquired by "delete_volume" :: waited 0.025s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:11 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2c714a-cf98-4a57-b831-a689efeaecfd]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-809ef0d7-7eae-493f-8de8-01d37697a602 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-15607532-0715-4b5e-a95c-1e90e9a06d30 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:11 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6bde4519-42e7-4cc6-8b3b-3dd396954259 tempest-CreateVolumesFromImageTest-1498478426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-201c3fa7-9bc1-4a60-9dc8-6380f5de30ef" returned: 0 in 1.086s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6bde4519-42e7-4cc6-8b3b-3dd396954259 tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-201c3fa7-9bc1-4a60-9dc8-6380f5de30ef {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:11 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-201c3fa7-9bc1-4a60-9dc8-6380f5de30ef Jul 10 05:00:11 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:11 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-15607532-0715-4b5e-a95c-1e90e9a06d30 Jul 10 05:00:11 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:12 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5710cdd1-66af-421d-a818-9ee0b118ba85 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.988s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:12 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-5710cdd1-66af-421d-a818-9ee0b118ba85 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:00:12 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-5710cdd1-66af-421d-a818-9ee0b118ba85 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Deleted volume successfully. Jul 10 05:00:12 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5710cdd1-66af-421d-a818-9ee0b118ba85 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-df198d7b-7d14-49ca-965b-12024d406ff4-delete_volume" released by "delete_volume" :: held 3.194s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:12 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdec91ed-5d2d-485e-94b1-3b6ba244a579_aa5002f2" returned: 1 in 1.015s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdec91ed-5d2d-485e-94b1-3b6ba244a579_aa5002f2' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 05:00:12 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec35dbe-cecd-4100-a546-2e28a1cd6b69]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:12 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7dd68f90-0d91-42b2-9135-b32833a37f9a tempest-VolumeDependencyTests-111182761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84 1G" returned: 0 in 1.242s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7dd68f90-0d91-42b2-9135-b32833a37f9a tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:12 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84 Jul 10 05:00:12 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:12 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD Jul 10 05:00:12 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:12 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-809ef0d7-7eae-493f-8de8-01d37697a602 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-15607532-0715-4b5e-a95c-1e90e9a06d30" returned: 0 in 0.962s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-809ef0d7-7eae-493f-8de8-01d37697a602 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-15607532-0715-4b5e-a95c-1e90e9a06d30 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:12 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-15607532-0715-4b5e-a95c-1e90e9a06d30 Jul 10 05:00:12 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:12 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6bde4519-42e7-4cc6-8b3b-3dd396954259 tempest-CreateVolumesFromImageTest-1498478426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-201c3fa7-9bc1-4a60-9dc8-6380f5de30ef" returned: 0 in 0.980s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:12 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6bde4519-42e7-4cc6-8b3b-3dd396954259 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "cinder-quobyte-201c3fa7-9bc1-4a60-9dc8-6380f5de30ef" released by "delete_volume" :: held 2.120s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:12 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-6bde4519-42e7-4cc6-8b3b-3dd396954259 tempest-CreateVolumesFromImageTest-1498478426 None] Created reservations ['518dd140-40b8-4b24-b65c-39ef2f851f85', '73c7e9f8-5653-4d7b-97cb-508d179d7113', '59310f8f-b81a-4908-90c5-c7ee7e1c0ca5', '5192453b-9c0d-4884-b698-3c773d598cd7'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:00:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6bde4519-42e7-4cc6-8b3b-3dd396954259 tempest-CreateVolumesFromImageTest-1498478426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6bde4519-42e7-4cc6-8b3b-3dd396954259 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6bde4519-42e7-4cc6-8b3b-3dd396954259 tempest-CreateVolumesFromImageTest-1498478426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6bde4519-42e7-4cc6-8b3b-3dd396954259 tempest-CreateVolumesFromImageTest-1498478426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6bde4519-42e7-4cc6-8b3b-3dd396954259 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6bde4519-42e7-4cc6-8b3b-3dd396954259 tempest-CreateVolumesFromImageTest-1498478426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:12 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:00:12 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:13 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7dd68f90-0d91-42b2-9135-b32833a37f9a tempest-VolumeDependencyTests-111182761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84" returned: 0 in 0.816s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:13 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-7dd68f90-0d91-42b2-9135-b32833a37f9a tempest-VolumeDependencyTests-111182761 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84 is being set with open permissions: ugo+rw Jul 10 05:00:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7dd68f90-0d91-42b2-9135-b32833a37f9a tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:13 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD" returned: 0 in 0.924s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:13 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84 Jul 10 05:00:13 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:13 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-809ef0d7-7eae-493f-8de8-01d37697a602 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-15607532-0715-4b5e-a95c-1e90e9a06d30" returned: 0 in 0.820s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-809ef0d7-7eae-493f-8de8-01d37697a602 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-quobyte-15607532-0715-4b5e-a95c-1e90e9a06d30" released by "delete_volume" :: held 1.846s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:13 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD Jul 10 05:00:13 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:13 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-809ef0d7-7eae-493f-8de8-01d37697a602 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Created reservations ['1468c41b-8209-485b-8967-2d93665e4cfe', 'c871da37-de1d-4466-b920-a3c0dbf7aa4f', '838095da-5361-47d7-a63b-69197ac99551', '7892c76a-1abf-4f70-bbaf-a5e0e19702a6'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:00:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-809ef0d7-7eae-493f-8de8-01d37697a602 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-809ef0d7-7eae-493f-8de8-01d37697a602 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:13 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-809ef0d7-7eae-493f-8de8-01d37697a602 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:13 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-809ef0d7-7eae-493f-8de8-01d37697a602 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-809ef0d7-7eae-493f-8de8-01d37697a602 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-809ef0d7-7eae-493f-8de8-01d37697a602 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:13 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6bde4519-42e7-4cc6-8b3b-3dd396954259 tempest-CreateVolumesFromImageTest-1498478426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.722s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:13 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-6bde4519-42e7-4cc6-8b3b-3dd396954259 tempest-CreateVolumesFromImageTest-1498478426 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:00:13 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-6bde4519-42e7-4cc6-8b3b-3dd396954259 tempest-CreateVolumesFromImageTest-1498478426 None] Deleted volume successfully. Jul 10 05:00:13 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:00:13 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-6bde4519-42e7-4cc6-8b3b-3dd396954259 tempest-CreateVolumesFromImageTest-1498478426 None] Lock "cinder-201c3fa7-9bc1-4a60-9dc8-6380f5de30ef-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a4e8c098-32c5-4685-8f0d-afe35664aad2 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "cinder-4e74248a-8516-47a5-a170-e3daf013e556-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a4e8c098-32c5-4685-8f0d-afe35664aad2 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-4e74248a-8516-47a5-a170-e3daf013e556-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a4e8c098-32c5-4685-8f0d-afe35664aad2 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "cinder-quobyte-4e74248a-8516-47a5-a170-e3daf013e556" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:13 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a4e8c098-32c5-4685-8f0d-afe35664aad2 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-quobyte-4e74248a-8516-47a5-a170-e3daf013e556" acquired by "delete_volume" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:13 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[07218bc4-6d59-4c29-8874-45705a01d3ba]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a4e8c098-32c5-4685-8f0d-afe35664aad2 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4e74248a-8516-47a5-a170-e3daf013e556 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:13 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4e74248a-8516-47a5-a170-e3daf013e556 Jul 10 05:00:13 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:14 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7dd68f90-0d91-42b2-9135-b32833a37f9a tempest-VolumeDependencyTests-111182761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84" returned: 0 in 0.981s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:14 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD" returned: 1 in 0.967s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 05:00:14 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] bdec91ed-5d2d-485e-94b1-3b6ba244a579 was raw, converting to raw {{(pid=87359) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Jul 10 05:00:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:14 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188 Jul 10 05:00:14 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7dd68f90-0d91-42b2-9135-b32833a37f9a tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:14 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.info Jul 10 05:00:14 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:14 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-809ef0d7-7eae-493f-8de8-01d37697a602 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.911s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:14 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-809ef0d7-7eae-493f-8de8-01d37697a602 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:00:14 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-809ef0d7-7eae-493f-8de8-01d37697a602 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Deleted volume successfully. Jul 10 05:00:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-809ef0d7-7eae-493f-8de8-01d37697a602 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-15607532-0715-4b5e-a95c-1e90e9a06d30-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:14 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a4e8c098-32c5-4685-8f0d-afe35664aad2 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4e74248a-8516-47a5-a170-e3daf013e556" returned: 0 in 0.949s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a4e8c098-32c5-4685-8f0d-afe35664aad2 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4e74248a-8516-47a5-a170-e3daf013e556 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:14 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4e74248a-8516-47a5-a170-e3daf013e556 Jul 10 05:00:14 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:15 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7dd68f90-0d91-42b2-9135-b32833a37f9a tempest-VolumeDependencyTests-111182761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.info" returned: 0 in 0.812s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:15 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-7dd68f90-0d91-42b2-9135-b32833a37f9a tempest-VolumeDependencyTests-111182761 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.info is being set with open permissions: ugo+rw Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7dd68f90-0d91-42b2-9135-b32833a37f9a tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:15 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.info Jul 10 05:00:15 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:15 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188" returned: 0 in 0.940s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bdec91ed-5d2d-485e-94b1-3b6ba244a579__nzq98ufdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188 {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 05:00:15 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:15 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188 1G Jul 10 05:00:15 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:15 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a4e8c098-32c5-4685-8f0d-afe35664aad2 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-4e74248a-8516-47a5-a170-e3daf013e556" returned: 0 in 0.895s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a4e8c098-32c5-4685-8f0d-afe35664aad2 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-quobyte-4e74248a-8516-47a5-a170-e3daf013e556" released by "delete_volume" :: held 1.901s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-a4e8c098-32c5-4685-8f0d-afe35664aad2 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Created reservations ['d2e3653e-a5af-4dba-bc8c-8539dfe6d1a3', '34919e0d-93e5-4b98-a45f-8174c64ef451', '2ad98a34-675c-4785-ae11-ba77f713b537', '108055e2-de03-46ae-9ad9-a1af9e5c4ec5'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a4e8c098-32c5-4685-8f0d-afe35664aad2 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a4e8c098-32c5-4685-8f0d-afe35664aad2 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a4e8c098-32c5-4685-8f0d-afe35664aad2 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a4e8c098-32c5-4685-8f0d-afe35664aad2 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a4e8c098-32c5-4685-8f0d-afe35664aad2 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a4e8c098-32c5-4685-8f0d-afe35664aad2 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:15 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7dd68f90-0d91-42b2-9135-b32833a37f9a tempest-VolumeDependencyTests-111182761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.info" returned: 0 in 0.813s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:15 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:00:15 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7dd68f90-0d91-42b2-9135-b32833a37f9a tempest-VolumeDependencyTests-111182761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.827s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5dcd3a88-7833-4127-a0f2-0f8213c8923b tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "cinder-68eaae9b-3977-4666-b3d9-e700cb48c586-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:15 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:00:15 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:16 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-7dd68f90-0d91-42b2-9135-b32833a37f9a tempest-VolumeDependencyTests-111182761 None] Create snapshot completed successfully Jul 10 05:00:16 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5dcd3a88-7833-4127-a0f2-0f8213c8923b tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-68eaae9b-3977-4666-b3d9-e700cb48c586-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:16 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5dcd3a88-7833-4127-a0f2-0f8213c8923b tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "cinder-quobyte-68eaae9b-3977-4666-b3d9-e700cb48c586" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:16 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5dcd3a88-7833-4127-a0f2-0f8213c8923b tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-quobyte-68eaae9b-3977-4666-b3d9-e700cb48c586" acquired by "delete_volume" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:16 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188 1G" returned: 0 in 1.065s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:16 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bb0ad4-7c1a-458d-8f13-1f60e314ebec]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5dcd3a88-7833-4127-a0f2-0f8213c8923b tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68eaae9b-3977-4666-b3d9-e700cb48c586 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:16 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab56c40-44d3-4bb3-b296-ef40134ee118]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:16 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68eaae9b-3977-4666-b3d9-e700cb48c586 Jul 10 05:00:16 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:16 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188 Jul 10 05:00:16 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:16 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a4e8c098-32c5-4685-8f0d-afe35664aad2 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.934s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-a4e8c098-32c5-4685-8f0d-afe35664aad2 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:00:16 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a4e8c098-32c5-4685-8f0d-afe35664aad2 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Deleted volume successfully. Jul 10 05:00:16 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a4e8c098-32c5-4685-8f0d-afe35664aad2 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-4e74248a-8516-47a5-a170-e3daf013e556-delete_volume" released by "delete_volume" :: held 3.168s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:16 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.008s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:00:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:00:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 05:00:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Flow 'volume_create_manager' (57fe2091-a6a0-4e0d-935d-2faedaa07d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3a4515-300d-4ea1-8589-0d1b1d43bf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3a4515-300d-4ea1-8589-0d1b1d43bf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1846342055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b85e02-9620-42dd-bb49-31d785d35a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f1c4a47713c46b08df7d60f7caf062f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b964a98d-a502-41d4-9ff2-a3eaf042ef84,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:17Z,use_quota=True,user_id='5fb974c7c8844199af122f5efa95f67c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f43ab5-d15b-4e83-8510-299835a45667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f43ab5-d15b-4e83-8510-299835a45667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38ce7b6-452a-4a5f-b1d5-aaafbcb32272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38ce7b6-452a-4a5f-b1d5-aaafbcb32272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '60b85e02-9620-42dd-bb49-31d785d35a8f', 'volume_name': 'volume-60b85e02-9620-42dd-bb49-31d785d35a8f', 'volume_size': 1, 'snapshot_id': 'b964a98d-a502-41d4-9ff2-a3eaf042ef84'}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9be7b2-c798-4f32-92cc-908447828526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9be7b2-c798-4f32-92cc-908447828526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (613f14a3-4e92-4375-95c3-5728d3970a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:17 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Volume 60b85e02-9620-42dd-bb49-31d785d35a8f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-60b85e02-9620-42dd-bb49-31d785d35a8f', 'volume_size': 1, 'snapshot_id': 'b964a98d-a502-41d4-9ff2-a3eaf042ef84'} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Acquiring lock "cinder-quobyte-b964a98d-a502-41d4-9ff2-a3eaf042ef84-60b85e02-9620-42dd-bb49-31d785d35a8f" by "_create_volume_from_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Lock "cinder-quobyte-b964a98d-a502-41d4-9ff2-a3eaf042ef84-60b85e02-9620-42dd-bb49-31d785d35a8f" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Creating volume 60b85e02-9620-42dd-bb49-31d785d35a8f from snapshot b964a98d-a502-41d4-9ff2-a3eaf042ef84 {{(pid=87359) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:17 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Acquiring lock "cinder-quobyte-60b85e02-9620-42dd-bb49-31d785d35a8f" by "_copy_volume_from_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5dcd3a88-7833-4127-a0f2-0f8213c8923b tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68eaae9b-3977-4666-b3d9-e700cb48c586" returned: 0 in 1.234s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5dcd3a88-7833-4127-a0f2-0f8213c8923b tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68eaae9b-3977-4666-b3d9-e700cb48c586 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Lock "cinder-quobyte-60b85e02-9620-42dd-bb49-31d785d35a8f" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] snapshot: b964a98d-a502-41d4-9ff2-a3eaf042ef84, volume: 60b85e02-9620-42dd-bb49-31d785d35a8f, {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 05:00:17 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68eaae9b-3977-4666-b3d9-e700cb48c586 Jul 10 05:00:17 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b7d4d1-3248-4fc6-b3e3-06e984004938]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:17 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188" returned: 0 in 1.346s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:17 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84 Jul 10 05:00:17 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:17 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188 Jul 10 05:00:17 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Flow 'volume_create_manager' (929fc76d-cfec-42d1-9d10-9b92d92a2c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d965c193-ec8f-4edd-96d3-6aa4ec57c51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d965c193-ec8f-4edd-96d3-6aa4ec57c51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-707556108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c42b61bb-0d38-4cba-b937-1112281116c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec259673c5ea425ea8851c25df3aea28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:18Z,use_quota=True,user_id='328e21bca6184440b65ac09955c74751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb898519-b0ca-4666-9efc-27d67cb22060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb898519-b0ca-4666-9efc-27d67cb22060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86c9b51f-1414-4499-85fb-2747a14ab796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86c9b51f-1414-4499-85fb-2747a14ab796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c42b61bb-0d38-4cba-b937-1112281116c5', 'volume_name': 'volume-c42b61bb-0d38-4cba-b937-1112281116c5', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c68999a-5103-4d50-a2cd-06cf39d08990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c68999a-5103-4d50-a2cd-06cf39d08990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947bc8ea-2661-408c-b60f-3ba5c8ea1dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:17 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Volume c42b61bb-0d38-4cba-b937-1112281116c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c42b61bb-0d38-4cba-b937-1112281116c5', 'volume_size': 1} Jul 10 05:00:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:18 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5dcd3a88-7833-4127-a0f2-0f8213c8923b tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-68eaae9b-3977-4666-b3d9-e700cb48c586" returned: 0 in 0.804s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5dcd3a88-7833-4127-a0f2-0f8213c8923b tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-quobyte-68eaae9b-3977-4666-b3d9-e700cb48c586" released by "delete_volume" :: held 2.114s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-5dcd3a88-7833-4127-a0f2-0f8213c8923b tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Created reservations ['87d4c1d4-04ad-4a53-a4b9-d0acc0f80099', 'a15262f7-d96d-4c70-b0aa-11bfeca98fad', 'e35978e5-88cc-4a1f-a090-6ade478496b9', '94fe2920-2f67-4643-a666-6aa5b24f7b4e'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5dcd3a88-7833-4127-a0f2-0f8213c8923b tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5dcd3a88-7833-4127-a0f2-0f8213c8923b tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5dcd3a88-7833-4127-a0f2-0f8213c8923b tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5dcd3a88-7833-4127-a0f2-0f8213c8923b tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5dcd3a88-7833-4127-a0f2-0f8213c8923b tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5dcd3a88-7833-4127-a0f2-0f8213c8923b tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:18 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188" returned: 1 in 0.817s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Downloaded image bdec91ed-5d2d-485e-94b1-3b6ba244a579 ((None, [{'url': 'file:///opt/stack/data/glance/images/bdec91ed-5d2d-485e-94b1-3b6ba244a579', 'metadata': {}}])) to volume 3e2caa2b-0689-4c36-8acd-23877eef0188 successfully. {{(pid=87359) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Temporary image bdec91ed-5d2d-485e-94b1-3b6ba244a579 for user 3bbe856181e24be38140b5af9aae28de is deleted. {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Marking volume 3e2caa2b-0689-4c36-8acd-23877eef0188 as bootable. {{(pid=87359) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 05:00:18 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:00:18 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Copying metadata from image bdec91ed-5d2d-485e-94b1-3b6ba244a579 to 3e2caa2b-0689-4c36-8acd-23877eef0188. {{(pid=87359) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Creating volume glance metadata for volume 3e2caa2b-0689-4c36-8acd-23877eef0188 backed by image bdec91ed-5d2d-485e-94b1-3b6ba244a579 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'bdec91ed-5d2d-485e-94b1-3b6ba244a579', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '966a231929c5157d408a7a324324edac', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87359) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 05:00:18 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84" returned: 0 in 0.928s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44cd8e81-03f2-46fd-a63d-10539ff66a09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Creating direct copy from snapshot {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[585ecd28-cb6b-4ea3-aeb4-98ab6d7a3944]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc8bf032-48d1-4341-85a9-7b12f3dde922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e2caa2b-0689-4c36-8acd-23877eef0188', 'volume_size': 1, 'image_id': 'bdec91ed-5d2d-485e-94b1-3b6ba244a579', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdec91ed-5d2d-485e-94b1-3b6ba244a579', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '966a231929c5157d408a7a324324edac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ecafdbf8b801493dbaf82f0d488aedcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '218f302ae5682605a256abda04ada323c3303c9f0be1f45cb42224e9fc1633634e14401ee31a4f14ed448d791a0c6de449fb32fd7397ed9f0ba2462a7834a739', 'id': 'bdec91ed-5d2d-485e-94b1-3b6ba244a579', 'created_at': datetime.datetime(2026, 7, 10, 2, 59, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 59, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdec91ed-5d2d-485e-94b1-3b6ba244a579/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18969228-c6f6-4ad9-b0b7-97f501f5071d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:18 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Volume volume-3e2caa2b-0689-4c36-8acd-23877eef0188 (3e2caa2b-0689-4c36-8acd-23877eef0188): created successfully Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18969228-c6f6-4ad9-b0b7-97f501f5071d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Flow 'volume_create_manager' (81b9080c-27bb-41fa-8879-a7a36ec2a35b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:18 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-50542720-f53c-4d78-8ce5-147b974aadef tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Created volume successfully. Jul 10 05:00:18 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 Jul 10 05:00:18 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Acquiring lock "cinder-3e2caa2b-0689-4c36-8acd-23877eef0188-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Lock "cinder-3e2caa2b-0689-4c36-8acd-23877eef0188-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Acquiring lock "cinder-quobyte-3e2caa2b-0689-4c36-8acd-23877eef0188" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Lock "cinder-quobyte-3e2caa2b-0689-4c36-8acd-23877eef0188" acquired by "delete_volume" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e612143b-c9db-4c17-bcff-bd38069bf98f]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:19 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188 Jul 10 05:00:19 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:19 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5dcd3a88-7833-4127-a0f2-0f8213c8923b tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.728s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:19 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-5dcd3a88-7833-4127-a0f2-0f8213c8923b tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:00:19 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-5dcd3a88-7833-4127-a0f2-0f8213c8923b tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Deleted volume successfully. Jul 10 05:00:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-5dcd3a88-7833-4127-a0f2-0f8213c8923b tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-68eaae9b-3977-4666-b3d9-e700cb48c586-delete_volume" released by "delete_volume" :: held 3.133s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:19 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09" returned: 0 in 0.848s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:19 devstack cinder-volume[87359]: DEBUG cinder.utils [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Path /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-60b85e02-9620-42dd-bb49-31d785d35a8f not found in is_blk_device check {{(pid=87359) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 05:00:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-60b85e02-9620-42dd-bb49-31d785d35a8f {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:19 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-60b85e02-9620-42dd-bb49-31d785d35a8f Jul 10 05:00:19 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ec8c97de-3832-4177-9a7e-df0edfde1166 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "cinder-bddc988f-0575-40d7-b89e-08df98271d05-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ec8c97de-3832-4177-9a7e-df0edfde1166 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-bddc988f-0575-40d7-b89e-08df98271d05-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ec8c97de-3832-4177-9a7e-df0edfde1166 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "cinder-quobyte-bddc988f-0575-40d7-b89e-08df98271d05" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ec8c97de-3832-4177-9a7e-df0edfde1166 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-quobyte-bddc988f-0575-40d7-b89e-08df98271d05" acquired by "delete_volume" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:19 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[944ff946-652a-4fbd-a0b7-a96d8e4ab73f]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec8c97de-3832-4177-9a7e-df0edfde1166 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bddc988f-0575-40d7-b89e-08df98271d05 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:19 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bddc988f-0575-40d7-b89e-08df98271d05 Jul 10 05:00:19 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:19 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188" returned: 0 in 0.811s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:19 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188 Jul 10 05:00:19 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:20 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec8c97de-3832-4177-9a7e-df0edfde1166 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bddc988f-0575-40d7-b89e-08df98271d05" returned: 0 in 1.196s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec8c97de-3832-4177-9a7e-df0edfde1166 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bddc988f-0575-40d7-b89e-08df98271d05 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:20 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bddc988f-0575-40d7-b89e-08df98271d05 Jul 10 05:00:20 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:21 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188" returned: 1 in 1.475s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 05:00:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:21 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188 Jul 10 05:00:21 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:22 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3e2caa2b-0689-4c36-8acd-23877eef0188" returned: 0 in 1.170s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Lock "cinder-quobyte-3e2caa2b-0689-4c36-8acd-23877eef0188" released by "delete_volume" :: held 3.556s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:22 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec8c97de-3832-4177-9a7e-df0edfde1166 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bddc988f-0575-40d7-b89e-08df98271d05" returned: 0 in 1.694s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ec8c97de-3832-4177-9a7e-df0edfde1166 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-quobyte-bddc988f-0575-40d7-b89e-08df98271d05" released by "delete_volume" :: held 2.968s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:22 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-ec8c97de-3832-4177-9a7e-df0edfde1166 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Created reservations ['dd814472-e2a4-4861-8a8b-58432744e9d1', '97f0072b-2b83-4462-9113-ed0c4b12fa69', '828484ba-c57d-4af6-af10-5c1e963bb4ea', '4a010fb5-4626-4927-a21c-7a62e1f19cc3'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:00:22 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Created reservations ['c6c821ec-8d42-474e-8741-cd31633663db', 'd8771176-4a6b-4458-928b-3bf430519da6', 'f714dc49-e8b8-4e22-8ace-9f71c2d8dc9f', '13bfa25b-07bc-461c-88f3-bfbf917b960c'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:00:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ec8c97de-3832-4177-9a7e-df0edfde1166 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ec8c97de-3832-4177-9a7e-df0edfde1166 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ec8c97de-3832-4177-9a7e-df0edfde1166 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ec8c97de-3832-4177-9a7e-df0edfde1166 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ec8c97de-3832-4177-9a7e-df0edfde1166 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec8c97de-3832-4177-9a7e-df0edfde1166 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:22 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:00:22 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:23 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7d6a56ab-af2b-4c2a-98ca-a849773c98d6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "cinder-69e0c446-d27d-44ec-a19a-5cc316b09132-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:23 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7d6a56ab-af2b-4c2a-98ca-a849773c98d6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-69e0c446-d27d-44ec-a19a-5cc316b09132-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:23 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:00:23 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:23 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7d6a56ab-af2b-4c2a-98ca-a849773c98d6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "cinder-quobyte-69e0c446-d27d-44ec-a19a-5cc316b09132" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:23 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7d6a56ab-af2b-4c2a-98ca-a849773c98d6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-quobyte-69e0c446-d27d-44ec-a19a-5cc316b09132" acquired by "delete_volume" :: waited 0.061s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:23 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24cc928-0d01-4b7c-9312-6c679be882d2]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7d6a56ab-af2b-4c2a-98ca-a849773c98d6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-69e0c446-d27d-44ec-a19a-5cc316b09132 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:23 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-69e0c446-d27d-44ec-a19a-5cc316b09132 Jul 10 05:00:23 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:23 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec8c97de-3832-4177-9a7e-df0edfde1166 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.938s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:23 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-ec8c97de-3832-4177-9a7e-df0edfde1166 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:00:23 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ec8c97de-3832-4177-9a7e-df0edfde1166 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Deleted volume successfully. Jul 10 05:00:23 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ec8c97de-3832-4177-9a7e-df0edfde1166 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-bddc988f-0575-40d7-b89e-08df98271d05-delete_volume" released by "delete_volume" :: held 4.514s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:24 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7d6a56ab-af2b-4c2a-98ca-a849773c98d6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-69e0c446-d27d-44ec-a19a-5cc316b09132" returned: 0 in 1.469s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7d6a56ab-af2b-4c2a-98ca-a849773c98d6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-69e0c446-d27d-44ec-a19a-5cc316b09132 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:24 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-69e0c446-d27d-44ec-a19a-5cc316b09132 Jul 10 05:00:24 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:25 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 2.123s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:25 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:00:25 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Deleted volume successfully. Jul 10 05:00:25 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c0926478-5526-483c-8e3d-aa8405ead6cf tempest-VolumeAndVolumeTypeFromImageTest-2044470970 None] Lock "cinder-3e2caa2b-0689-4c36-8acd-23877eef0188-delete_volume" released by "delete_volume" :: held 6.368s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:25 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-60b85e02-9620-42dd-bb49-31d785d35a8f" returned: 0 in 6.551s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:25 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f27d080-af0b-4553-bf6f-0f824d7d5c08]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:26 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 Jul 10 05:00:26 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:26 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7d6a56ab-af2b-4c2a-98ca-a849773c98d6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-69e0c446-d27d-44ec-a19a-5cc316b09132" returned: 0 in 1.191s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:26 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7d6a56ab-af2b-4c2a-98ca-a849773c98d6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-quobyte-69e0c446-d27d-44ec-a19a-5cc316b09132" released by "delete_volume" :: held 2.780s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:26 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-7d6a56ab-af2b-4c2a-98ca-a849773c98d6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Created reservations ['0637c769-3975-4810-a192-a5d9658e490a', '2ee5dd71-be3d-4b2c-af73-e980b325261f', '5e5f653f-a1c2-4bdd-9c0f-39c1222380f6', '90ab632d-7267-4457-9d8c-69fa44c137ba'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:00:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7d6a56ab-af2b-4c2a-98ca-a849773c98d6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7d6a56ab-af2b-4c2a-98ca-a849773c98d6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7d6a56ab-af2b-4c2a-98ca-a849773c98d6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7d6a56ab-af2b-4c2a-98ca-a849773c98d6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7d6a56ab-af2b-4c2a-98ca-a849773c98d6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7d6a56ab-af2b-4c2a-98ca-a849773c98d6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:26 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:00:26 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:27 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09" returned: 0 in 1.221s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:27 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09, size 1024.00 MB, duration 6.55 sec, destination /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-60b85e02-9620-42dd-bb49-31d785d35a8f {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 05:00:27 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Converted 1024.00 MB image at 156.28 MB/s Jul 10 05:00:27 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-60b85e02-9620-42dd-bb49-31d785d35a8f is being set with open permissions: ugo+rw Jul 10 05:00:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-60b85e02-9620-42dd-bb49-31d785d35a8f {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:27 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7d6a56ab-af2b-4c2a-98ca-a849773c98d6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.859s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:27 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-7d6a56ab-af2b-4c2a-98ca-a849773c98d6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:00:27 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-7d6a56ab-af2b-4c2a-98ca-a849773c98d6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Deleted volume successfully. Jul 10 05:00:27 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-60b85e02-9620-42dd-bb49-31d785d35a8f Jul 10 05:00:27 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7d6a56ab-af2b-4c2a-98ca-a849773c98d6 tempest-CreateVolumesFromSourceVolumeTest-1559954317 None] Lock "cinder-69e0c446-d27d-44ec-a19a-5cc316b09132-delete_volume" released by "delete_volume" :: held 4.077s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:27 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-60b85e02-9620-42dd-bb49-31d785d35a8f" returned: 0 in 0.773s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Lock "cinder-quobyte-60b85e02-9620-42dd-bb49-31d785d35a8f" released by "_copy_volume_from_snapshot" :: held 10.465s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Lock "cinder-quobyte-b964a98d-a502-41d4-9ff2-a3eaf042ef84-60b85e02-9620-42dd-bb49-31d785d35a8f" released by "_create_volume_from_snapshot" :: held 10.517s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.537s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.956s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-707556108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c42b61bb-0d38-4cba-b937-1112281116c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec259673c5ea425ea8851c25df3aea28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:18Z,use_quota=True,user_id='328e21bca6184440b65ac09955c74751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:00:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Creating volume c42b61bb-0d38-4cba-b937-1112281116c5 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:00:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:00:27 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:00:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:27 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5 1073741824 Jul 10 05:00:27 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (613f14a3-4e92-4375-95c3-5728d3970a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60b85e02-9620-42dd-bb49-31d785d35a8f', 'volume_size': 1, 'snapshot_id': 'b964a98d-a502-41d4-9ff2-a3eaf042ef84'}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7035618-4044-432a-8f47-5f523b865895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:28 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Volume volume-60b85e02-9620-42dd-bb49-31d785d35a8f (60b85e02-9620-42dd-bb49-31d785d35a8f): created successfully Jul 10 05:00:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7035618-4044-432a-8f47-5f523b865895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:28 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Flow 'volume_create_manager' (57fe2091-a6a0-4e0d-935d-2faedaa07d2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:28 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-444a67b3-17ac-49ff-a449-904758a48679 tempest-VolumeDependencyTests-111182761 None] Created volume successfully. Jul 10 05:00:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8ea61147-c51b-4f0a-88ab-dfd859355014 tempest-VolumeDependencyTests-111182761 None] Acquiring lock "cinder-b964a98d-a502-41d4-9ff2-a3eaf042ef84-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8ea61147-c51b-4f0a-88ab-dfd859355014 tempest-VolumeDependencyTests-111182761 None] Lock "cinder-b964a98d-a502-41d4-9ff2-a3eaf042ef84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8ea61147-c51b-4f0a-88ab-dfd859355014 tempest-VolumeDependencyTests-111182761 None] Acquiring lock "cinder-quobyte-44cd8e81-03f2-46fd-a63d-10539ff66a09" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8ea61147-c51b-4f0a-88ab-dfd859355014 tempest-VolumeDependencyTests-111182761 None] Lock "cinder-quobyte-44cd8e81-03f2-46fd-a63d-10539ff66a09" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8ea61147-c51b-4f0a-88ab-dfd859355014 tempest-VolumeDependencyTests-111182761 None] Acquiring lock "cinder-quobyte-b964a98d-a502-41d4-9ff2-a3eaf042ef84" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8ea61147-c51b-4f0a-88ab-dfd859355014 tempest-VolumeDependencyTests-111182761 None] Lock "cinder-quobyte-b964a98d-a502-41d4-9ff2-a3eaf042ef84" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-8ea61147-c51b-4f0a-88ab-dfd859355014 tempest-VolumeDependencyTests-111182761 None] Deleting offline snapshot b964a98d-a502-41d4-9ff2-a3eaf042ef84 of volume 44cd8e81-03f2-46fd-a63d-10539ff66a09 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:00:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-8ea61147-c51b-4f0a-88ab-dfd859355014 tempest-VolumeDependencyTests-111182761 None] snapshot_file for this snap is: volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:00:28 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc96a3a-e7e1-475e-9b3f-71a1b296b457]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8ea61147-c51b-4f0a-88ab-dfd859355014 tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:28 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84 Jul 10 05:00:28 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:28 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5 1073741824" returned: 0 in 1.032s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:29 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5 Jul 10 05:00:29 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:29 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8ea61147-c51b-4f0a-88ab-dfd859355014 tempest-VolumeDependencyTests-111182761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84" returned: 0 in 0.911s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-8ea61147-c51b-4f0a-88ab-dfd859355014 tempest-VolumeDependencyTests-111182761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44cd8e81-03f2-46fd-a63d-10539ff66a09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:00:29 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[0199cfce-247f-4f27-a3c8-d34305d3df2b]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8ea61147-c51b-4f0a-88ab-dfd859355014 tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:29 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 Jul 10 05:00:29 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:29 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5" returned: 0 in 0.743s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:00:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947bc8ea-2661-408c-b60f-3ba5c8ea1dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c42b61bb-0d38-4cba-b937-1112281116c5', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5258ac9-76ac-4ca4-9fc7-af1fd8a4baee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:29 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Volume volume-c42b61bb-0d38-4cba-b937-1112281116c5 (c42b61bb-0d38-4cba-b937-1112281116c5): created successfully Jul 10 05:00:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5258ac9-76ac-4ca4-9fc7-af1fd8a4baee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:29 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Flow 'volume_create_manager' (929fc76d-cfec-42d1-9d10-9b92d92a2c4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:29 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-647a6971-ac3a-4d91-ae4e-e762f90102a8 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Created volume successfully. Jul 10 05:00:30 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8ea61147-c51b-4f0a-88ab-dfd859355014 tempest-VolumeDependencyTests-111182761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09" returned: 0 in 0.953s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8ea61147-c51b-4f0a-88ab-dfd859355014 tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:30 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84 Jul 10 05:00:30 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-cc39bf6f-4979-4a40-887f-3540ee38bd04 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-cc39bf6f-4979-4a40-887f-3540ee38bd04 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:30 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-cc39bf6f-4979-4a40-887f-3540ee38bd04 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Creating offline snapshot db46d498-02ae-4233-a36f-979a06e9b112 of volume c42b61bb-0d38-4cba-b937-1112281116c5 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:00:30 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:00:30 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Flow 'volume_create_manager' (b45ccb74-e91a-4c39-95c0-5c8520a85847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:30 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08103799-88f2-4c01-a3a0-08125373cd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:30 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cf4b2e-d6e7-4b4a-8676-7b81544ced83]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cc39bf6f-4979-4a40-887f-3540ee38bd04 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:30 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08103799-88f2-4c01-a3a0-08125373cd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a578b830-a891-43ae-9446-12784658a006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4836888160b4f80b413ee933c86b2d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:31Z,use_quota=True,user_id='34910844ae6a4b63bfe4deb7caad2468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:30 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c144226-3fa0-4b3a-9a2e-941835339e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:30 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c144226-3fa0-4b3a-9a2e-941835339e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:30 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd30130-0a87-487a-840a-ea83c8b85769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:30 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd30130-0a87-487a-840a-ea83c8b85769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a578b830-a891-43ae-9446-12784658a006', 'volume_name': 'volume-a578b830-a891-43ae-9446-12784658a006', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:30 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb822630-976b-4201-b5b7-245ace1ea9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:30 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb822630-976b-4201-b5b7-245ace1ea9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:30 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876fec22-b093-45a2-9f6e-1e7e984b9f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:30 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Volume a578b830-a891-43ae-9446-12784658a006: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a578b830-a891-43ae-9446-12784658a006', 'volume_size': 1} Jul 10 05:00:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:30 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5 Jul 10 05:00:30 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:31 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8ea61147-c51b-4f0a-88ab-dfd859355014 tempest-VolumeDependencyTests-111182761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84" returned: 0 in 0.816s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8ea61147-c51b-4f0a-88ab-dfd859355014 tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:31 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84 Jul 10 05:00:31 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:31 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cc39bf6f-4979-4a40-887f-3540ee38bd04 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5" returned: 0 in 0.808s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cc39bf6f-4979-4a40-887f-3540ee38bd04 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.db46d498-02ae-4233-a36f-979a06e9b112 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:31 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.db46d498-02ae-4233-a36f-979a06e9b112 1G Jul 10 05:00:31 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:31 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8ea61147-c51b-4f0a-88ab-dfd859355014 tempest-VolumeDependencyTests-111182761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09.b964a98d-a502-41d4-9ff2-a3eaf042ef84" returned: 0 in 0.663s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8ea61147-c51b-4f0a-88ab-dfd859355014 tempest-VolumeDependencyTests-111182761 None] Lock "cinder-quobyte-b964a98d-a502-41d4-9ff2-a3eaf042ef84" released by "_delete_snapshot" :: held 3.482s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8ea61147-c51b-4f0a-88ab-dfd859355014 tempest-VolumeDependencyTests-111182761 None] Lock "cinder-quobyte-44cd8e81-03f2-46fd-a63d-10539ff66a09" released by "delete_snapshot" :: held 3.510s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:32 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-8ea61147-c51b-4f0a-88ab-dfd859355014 tempest-VolumeDependencyTests-111182761 None] Created reservations ['883bc6a1-1ef4-4985-882d-d18da235375e', '0f9c6240-b9b2-484c-aa32-671986f875e7', '61389239-1b48-4635-b296-7ba955ae9e43', '72ef6a0d-cb9c-49e0-9221-060d89983684'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:00:32 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-8ea61147-c51b-4f0a-88ab-dfd859355014 tempest-VolumeDependencyTests-111182761 None] Delete snapshot completed successfully. Jul 10 05:00:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8ea61147-c51b-4f0a-88ab-dfd859355014 tempest-VolumeDependencyTests-111182761 None] Lock "cinder-b964a98d-a502-41d4-9ff2-a3eaf042ef84-delete_snapshot" released by "delete_snapshot" :: held 3.671s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:32 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cc39bf6f-4979-4a40-887f-3540ee38bd04 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.db46d498-02ae-4233-a36f-979a06e9b112 1G" returned: 0 in 0.889s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cc39bf6f-4979-4a40-887f-3540ee38bd04 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c42b61bb-0d38-4cba-b937-1112281116c5 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.db46d498-02ae-4233-a36f-979a06e9b112 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:32 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c42b61bb-0d38-4cba-b937-1112281116c5 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.db46d498-02ae-4233-a36f-979a06e9b112 Jul 10 05:00:32 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b7084e72-9a70-4986-a6cc-8311bde7af78 tempest-VolumeDependencyTests-111182761 None] Acquiring lock "cinder-44cd8e81-03f2-46fd-a63d-10539ff66a09-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b7084e72-9a70-4986-a6cc-8311bde7af78 tempest-VolumeDependencyTests-111182761 None] Lock "cinder-44cd8e81-03f2-46fd-a63d-10539ff66a09-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b7084e72-9a70-4986-a6cc-8311bde7af78 tempest-VolumeDependencyTests-111182761 None] Acquiring lock "cinder-quobyte-44cd8e81-03f2-46fd-a63d-10539ff66a09" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b7084e72-9a70-4986-a6cc-8311bde7af78 tempest-VolumeDependencyTests-111182761 None] Lock "cinder-quobyte-44cd8e81-03f2-46fd-a63d-10539ff66a09" acquired by "delete_volume" :: waited 0.023s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:32 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[82430379-754b-4753-96f7-24d6b222845c]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b7084e72-9a70-4986-a6cc-8311bde7af78 tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:33 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 Jul 10 05:00:33 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:33 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cc39bf6f-4979-4a40-887f-3540ee38bd04 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c42b61bb-0d38-4cba-b937-1112281116c5 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.db46d498-02ae-4233-a36f-979a06e9b112" returned: 0 in 0.788s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:33 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-cc39bf6f-4979-4a40-887f-3540ee38bd04 tempest-CreateVolumesFromSnapshotTest-2076719672 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.db46d498-02ae-4233-a36f-979a06e9b112 is being set with open permissions: ugo+rw Jul 10 05:00:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cc39bf6f-4979-4a40-887f-3540ee38bd04 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.db46d498-02ae-4233-a36f-979a06e9b112 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:33 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.db46d498-02ae-4233-a36f-979a06e9b112 Jul 10 05:00:33 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:33 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b7084e72-9a70-4986-a6cc-8311bde7af78 tempest-VolumeDependencyTests-111182761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09" returned: 0 in 0.845s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b7084e72-9a70-4986-a6cc-8311bde7af78 tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:33 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09 Jul 10 05:00:33 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:33 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cc39bf6f-4979-4a40-887f-3540ee38bd04 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.db46d498-02ae-4233-a36f-979a06e9b112" returned: 0 in 0.739s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cc39bf6f-4979-4a40-887f-3540ee38bd04 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:33 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.info Jul 10 05:00:33 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:34 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b7084e72-9a70-4986-a6cc-8311bde7af78 tempest-VolumeDependencyTests-111182761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-44cd8e81-03f2-46fd-a63d-10539ff66a09" returned: 0 in 0.671s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b7084e72-9a70-4986-a6cc-8311bde7af78 tempest-VolumeDependencyTests-111182761 None] Lock "cinder-quobyte-44cd8e81-03f2-46fd-a63d-10539ff66a09" released by "delete_volume" :: held 1.595s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:34 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-b7084e72-9a70-4986-a6cc-8311bde7af78 tempest-VolumeDependencyTests-111182761 None] Created reservations ['db4389da-19a7-4109-8a6f-f28b2e14e724', 'bde9b6ed-4aaa-4f08-b5d4-769fbd1907f4', 'ff08d7fd-c11a-4208-aab9-7756977bcca3', 'c3da3fa1-ff7c-4c42-bebb-bc12056b0979'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:00:34 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cc39bf6f-4979-4a40-887f-3540ee38bd04 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.info" returned: 0 in 0.690s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:34 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-cc39bf6f-4979-4a40-887f-3540ee38bd04 tempest-CreateVolumesFromSnapshotTest-2076719672 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.info is being set with open permissions: ugo+rw Jul 10 05:00:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cc39bf6f-4979-4a40-887f-3540ee38bd04 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b7084e72-9a70-4986-a6cc-8311bde7af78 tempest-VolumeDependencyTests-111182761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b7084e72-9a70-4986-a6cc-8311bde7af78 tempest-VolumeDependencyTests-111182761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-b7084e72-9a70-4986-a6cc-8311bde7af78 tempest-VolumeDependencyTests-111182761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-b7084e72-9a70-4986-a6cc-8311bde7af78 tempest-VolumeDependencyTests-111182761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b7084e72-9a70-4986-a6cc-8311bde7af78 tempest-VolumeDependencyTests-111182761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:34 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.info Jul 10 05:00:34 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b7084e72-9a70-4986-a6cc-8311bde7af78 tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:34 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:00:34 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9e6d0ce0-14f4-4e85-89d5-1bda50ebfe59 tempest-VolumeDependencyTests-111182761 None] Acquiring lock "cinder-60b85e02-9620-42dd-bb49-31d785d35a8f-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9e6d0ce0-14f4-4e85-89d5-1bda50ebfe59 tempest-VolumeDependencyTests-111182761 None] Lock "cinder-60b85e02-9620-42dd-bb49-31d785d35a8f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9e6d0ce0-14f4-4e85-89d5-1bda50ebfe59 tempest-VolumeDependencyTests-111182761 None] Acquiring lock "cinder-quobyte-60b85e02-9620-42dd-bb49-31d785d35a8f" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9e6d0ce0-14f4-4e85-89d5-1bda50ebfe59 tempest-VolumeDependencyTests-111182761 None] Lock "cinder-quobyte-60b85e02-9620-42dd-bb49-31d785d35a8f" acquired by "delete_volume" :: waited 0.022s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ef11ce-8123-4c9c-8e1c-d3bd2426badc]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9e6d0ce0-14f4-4e85-89d5-1bda50ebfe59 tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-60b85e02-9620-42dd-bb49-31d785d35a8f {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:35 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-60b85e02-9620-42dd-bb49-31d785d35a8f Jul 10 05:00:35 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:35 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cc39bf6f-4979-4a40-887f-3540ee38bd04 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.info" returned: 0 in 0.768s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-cc39bf6f-4979-4a40-887f-3540ee38bd04 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.858s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:35 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.707s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a578b830-a891-43ae-9446-12784658a006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4836888160b4f80b413ee933c86b2d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:31Z,use_quota=True,user_id='34910844ae6a4b63bfe4deb7caad2468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Creating volume a578b830-a891-43ae-9446-12784658a006 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:00:35 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a578b830-a891-43ae-9446-12784658a006 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b7084e72-9a70-4986-a6cc-8311bde7af78 tempest-VolumeDependencyTests-111182761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.810s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-b7084e72-9a70-4986-a6cc-8311bde7af78 tempest-VolumeDependencyTests-111182761 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:00:35 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a578b830-a891-43ae-9446-12784658a006 1073741824 Jul 10 05:00:35 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:35 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-b7084e72-9a70-4986-a6cc-8311bde7af78 tempest-VolumeDependencyTests-111182761 None] Deleted volume successfully. Jul 10 05:00:35 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-cc39bf6f-4979-4a40-887f-3540ee38bd04 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Create snapshot completed successfully Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b7084e72-9a70-4986-a6cc-8311bde7af78 tempest-VolumeDependencyTests-111182761 None] Lock "cinder-44cd8e81-03f2-46fd-a63d-10539ff66a09-delete_volume" released by "delete_volume" :: held 2.676s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Flow 'volume_create_manager' (6e2fabbf-a964-493e-8fa1-80a884e542fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180ebd96-b874-4b87-b7dc-7463d9047c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180ebd96-b874-4b87-b7dc-7463d9047c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657063886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d6bcb9-366b-431d-87ca-18493c48aed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3197eac694784dd6bff647edd9e49582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:36Z,use_quota=True,user_id='4abcde3dd0b34fba8f492d431f7a7696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c19ee5-d9bf-4332-a57d-6a20b6515825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c19ee5-d9bf-4332-a57d-6a20b6515825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11320e63-5581-4e71-bc92-7bd973dd95f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11320e63-5581-4e71-bc92-7bd973dd95f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48d6bcb9-366b-431d-87ca-18493c48aed1', 'volume_name': 'volume-48d6bcb9-366b-431d-87ca-18493c48aed1', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e110f65-0ae5-4f10-a3f3-758307890097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e110f65-0ae5-4f10-a3f3-758307890097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba323aa3-672f-4197-9ddd-1d537afe0f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:35 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Volume 48d6bcb9-366b-431d-87ca-18493c48aed1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48d6bcb9-366b-431d-87ca-18493c48aed1', 'volume_size': 1} Jul 10 05:00:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:36 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9e6d0ce0-14f4-4e85-89d5-1bda50ebfe59 tempest-VolumeDependencyTests-111182761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-60b85e02-9620-42dd-bb49-31d785d35a8f" returned: 0 in 0.923s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9e6d0ce0-14f4-4e85-89d5-1bda50ebfe59 tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-60b85e02-9620-42dd-bb49-31d785d35a8f {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:36 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-60b85e02-9620-42dd-bb49-31d785d35a8f Jul 10 05:00:36 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Flow 'volume_create_manager' (2a259058-6137-499f-8d28-d2837fa16bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd581a9-b57e-40f9-8c2f-3211558adc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd581a9-b57e-40f9-8c2f-3211558adc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1695923066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433609a3-38dc-479e-b7b9-a8dadf8aeb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec259673c5ea425ea8851c25df3aea28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:36Z,use_quota=True,user_id='328e21bca6184440b65ac09955c74751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7469359-36db-4834-9278-31bb4df504ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7469359-36db-4834-9278-31bb4df504ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca0f12c-0ba8-4cf7-8876-f7806fb3af3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca0f12c-0ba8-4cf7-8876-f7806fb3af3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '433609a3-38dc-479e-b7b9-a8dadf8aeb67', 'volume_name': 'volume-433609a3-38dc-479e-b7b9-a8dadf8aeb67', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b539c25a-d835-4fbd-835b-baa2191405c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b539c25a-d835-4fbd-835b-baa2191405c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8bc5b0-73e8-4172-b2f9-188ef6f582bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:36 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Volume 433609a3-38dc-479e-b7b9-a8dadf8aeb67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-433609a3-38dc-479e-b7b9-a8dadf8aeb67', 'volume_size': 1} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:36 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a578b830-a891-43ae-9446-12784658a006 1073741824" returned: 0 in 1.110s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a578b830-a891-43ae-9446-12784658a006 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:36 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a578b830-a891-43ae-9446-12784658a006 Jul 10 05:00:36 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Flow 'volume_create_manager' (daf9105e-cbc4-4a82-bd71-7d1e983130de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b421fa09-28a2-47ad-a08f-b4b1784984fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b421fa09-28a2-47ad-a08f-b4b1784984fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-358892603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dab1527-7679-4045-848e-554f48ac7597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec259673c5ea425ea8851c25df3aea28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:37Z,use_quota=True,user_id='328e21bca6184440b65ac09955c74751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c221a3f3-e95b-4f63-8d02-9d396daf03d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c221a3f3-e95b-4f63-8d02-9d396daf03d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b91953c3-0f78-4e9f-9575-1528adf63e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b91953c3-0f78-4e9f-9575-1528adf63e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dab1527-7679-4045-848e-554f48ac7597', 'volume_name': 'volume-3dab1527-7679-4045-848e-554f48ac7597', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb13046e-3c06-4e88-9c9b-607efbeee5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb13046e-3c06-4e88-9c9b-607efbeee5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e32afb0-701b-4e5f-9ec3-9365220bdadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:36 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Volume 3dab1527-7679-4045-848e-554f48ac7597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dab1527-7679-4045-848e-554f48ac7597', 'volume_size': 1} Jul 10 05:00:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:37 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9e6d0ce0-14f4-4e85-89d5-1bda50ebfe59 tempest-VolumeDependencyTests-111182761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-60b85e02-9620-42dd-bb49-31d785d35a8f" returned: 0 in 0.926s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9e6d0ce0-14f4-4e85-89d5-1bda50ebfe59 tempest-VolumeDependencyTests-111182761 None] Lock "cinder-quobyte-60b85e02-9620-42dd-bb49-31d785d35a8f" released by "delete_volume" :: held 1.911s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Flow 'volume_create_manager' (44cae943-c811-412b-a365-b21f8d96c942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0602f8-388d-4b5a-ad06-c07859cb341e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-9e6d0ce0-14f4-4e85-89d5-1bda50ebfe59 tempest-VolumeDependencyTests-111182761 None] Created reservations ['2271c758-17e2-41de-8a58-f0b19ba9a248', 'a0dbbf0b-b8e8-4410-beeb-6680e7007723', '8eb8a5fd-20a8-46d9-8e81-c0a600254de5', '7980c0d0-32b3-45dd-a63d-19c4f15465dc'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0602f8-388d-4b5a-ad06-c07859cb341e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1322250708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9887b461-99f5-4a2c-88b9-a35ace1c7243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec259673c5ea425ea8851c25df3aea28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:37Z,use_quota=True,user_id='328e21bca6184440b65ac09955c74751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1977c8bf-2b55-40a2-8440-4420db0c9279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1977c8bf-2b55-40a2-8440-4420db0c9279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab0a290-219c-4138-9349-7ef0b587cf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab0a290-219c-4138-9349-7ef0b587cf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9887b461-99f5-4a2c-88b9-a35ace1c7243', 'volume_name': 'volume-9887b461-99f5-4a2c-88b9-a35ace1c7243', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e353858c-bcff-4d00-9494-8ca8c4490616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e353858c-bcff-4d00-9494-8ca8c4490616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1fecf30-d651-4252-a13c-7c7ca7cb095d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:37 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Volume 9887b461-99f5-4a2c-88b9-a35ace1c7243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9887b461-99f5-4a2c-88b9-a35ace1c7243', 'volume_size': 1} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9e6d0ce0-14f4-4e85-89d5-1bda50ebfe59 tempest-VolumeDependencyTests-111182761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9e6d0ce0-14f4-4e85-89d5-1bda50ebfe59 tempest-VolumeDependencyTests-111182761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9e6d0ce0-14f4-4e85-89d5-1bda50ebfe59 tempest-VolumeDependencyTests-111182761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9e6d0ce0-14f4-4e85-89d5-1bda50ebfe59 tempest-VolumeDependencyTests-111182761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9e6d0ce0-14f4-4e85-89d5-1bda50ebfe59 tempest-VolumeDependencyTests-111182761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9e6d0ce0-14f4-4e85-89d5-1bda50ebfe59 tempest-VolumeDependencyTests-111182761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:37 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a578b830-a891-43ae-9446-12784658a006" returned: 0 in 0.773s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.951s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.524s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657063886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d6bcb9-366b-431d-87ca-18493c48aed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3197eac694784dd6bff647edd9e49582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:36Z,use_quota=True,user_id='4abcde3dd0b34fba8f492d431f7a7696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Creating volume 48d6bcb9-366b-431d-87ca-18493c48aed1 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:37 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:00:37 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:00:37 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:37 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1 1073741824 Jul 10 05:00:37 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876fec22-b093-45a2-9f6e-1e7e984b9f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a578b830-a891-43ae-9446-12784658a006', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3692265-46e0-4a49-822c-6fbbd5146aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:37 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Volume volume-a578b830-a891-43ae-9446-12784658a006 (a578b830-a891-43ae-9446-12784658a006): created successfully Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3692265-46e0-4a49-822c-6fbbd5146aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Flow 'volume_create_manager' (b45ccb74-e91a-4c39-95c0-5c8520a85847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:37 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c97285de-c4d7-4265-94fd-e8666c1830e7 tempest-CinderUnicodeTest-1487229715 None] Created volume successfully. Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Flow 'volume_create_manager' (4b340da5-b5d4-4649-84fc-586508ea993d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3382e289-c288-4ea5-81d9-bf1f39bf087f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3382e289-c288-4ea5-81d9-bf1f39bf087f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-918636819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c59541-e4d6-42c6-99d4-c8d298a32884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec259673c5ea425ea8851c25df3aea28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:38Z,use_quota=True,user_id='328e21bca6184440b65ac09955c74751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ddeec23-aebc-4ea9-a622-f02c7eca3f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ddeec23-aebc-4ea9-a622-f02c7eca3f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aefa3339-a0fb-4e73-9113-048ef78d826c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aefa3339-a0fb-4e73-9113-048ef78d826c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76c59541-e4d6-42c6-99d4-c8d298a32884', 'volume_name': 'volume-76c59541-e4d6-42c6-99d4-c8d298a32884', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7c9a7c-ca9f-442e-b984-b586e4aae6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7c9a7c-ca9f-442e-b984-b586e4aae6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f2dde5-d3e5-49cb-ad4e-df96d8e1afe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:37 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Volume 76c59541-e4d6-42c6-99d4-c8d298a32884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76c59541-e4d6-42c6-99d4-c8d298a32884', 'volume_size': 1} Jul 10 05:00:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:00:38 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Flow 'volume_create_manager' (063fc20c-d843-4d1b-bf24-4b6a6ac81153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f862f5d4-887c-4033-b5d6-645838415f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9e6d0ce0-14f4-4e85-89d5-1bda50ebfe59 tempest-VolumeDependencyTests-111182761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.961s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-9e6d0ce0-14f4-4e85-89d5-1bda50ebfe59 tempest-VolumeDependencyTests-111182761 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f862f5d4-887c-4033-b5d6-645838415f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2027631000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738cc5ee-56f3-4a41-b50a-dd7321069eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec259673c5ea425ea8851c25df3aea28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:38Z,use_quota=True,user_id='328e21bca6184440b65ac09955c74751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15caa7b2-0aa0-4658-9f20-d862949e5b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15caa7b2-0aa0-4658-9f20-d862949e5b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3986375c-2597-4298-8df4-c957b231cd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3986375c-2597-4298-8df4-c957b231cd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '738cc5ee-56f3-4a41-b50a-dd7321069eff', 'volume_name': 'volume-738cc5ee-56f3-4a41-b50a-dd7321069eff', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d0e76c-117e-4d50-92c1-6a091c42f2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d0e76c-117e-4d50-92c1-6a091c42f2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f38d6a-22de-40c7-94b5-c2c089c75f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:38 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Volume 738cc5ee-56f3-4a41-b50a-dd7321069eff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-738cc5ee-56f3-4a41-b50a-dd7321069eff', 'volume_size': 1} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:38 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-9e6d0ce0-14f4-4e85-89d5-1bda50ebfe59 tempest-VolumeDependencyTests-111182761 None] Deleted volume successfully. Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9e6d0ce0-14f4-4e85-89d5-1bda50ebfe59 tempest-VolumeDependencyTests-111182761 None] Lock "cinder-60b85e02-9620-42dd-bb49-31d785d35a8f-delete_volume" released by "delete_volume" :: held 3.285s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:38 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1 1073741824" returned: 0 in 1.127s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:38 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1 Jul 10 05:00:38 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=175,cinder:SELECT=127,cinder:DELETE=13,cinder:INSERT=41 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Flow 'volume_create_manager' (733fef6b-91c1-443d-a6b6-bb7c997bfcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3789b16-5b44-4336-9f9e-dfc88c775b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3789b16-5b44-4336-9f9e-dfc88c775b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-585653769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aabfd81f-589f-437f-9c57-6bad2e20b6be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4836888160b4f80b413ee933c86b2d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:39Z,use_quota=True,user_id='34910844ae6a4b63bfe4deb7caad2468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214014fc-79b8-43e4-8cde-0a21572eab25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214014fc-79b8-43e4-8cde-0a21572eab25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a7acda-987a-4c21-bdab-f45ecee989d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a7acda-987a-4c21-bdab-f45ecee989d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aabfd81f-589f-437f-9c57-6bad2e20b6be', 'volume_name': 'volume-aabfd81f-589f-437f-9c57-6bad2e20b6be', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12103c3f-804a-4fee-857b-deeeb748fde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12103c3f-804a-4fee-857b-deeeb748fde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdea51f9-923a-48fc-a459-c790e79600af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:38 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Volume aabfd81f-589f-437f-9c57-6bad2e20b6be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aabfd81f-589f-437f-9c57-6bad2e20b6be', 'volume_size': 1} Jul 10 05:00:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:39 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1" returned: 0 in 0.742s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:00:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.902s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1695923066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433609a3-38dc-479e-b7b9-a8dadf8aeb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec259673c5ea425ea8851c25df3aea28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:36Z,use_quota=True,user_id='328e21bca6184440b65ac09955c74751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:00:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Creating volume 433609a3-38dc-479e-b7b9-a8dadf8aeb67 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:00:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:00:39 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:00:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-433609a3-38dc-479e-b7b9-a8dadf8aeb67 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:39 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=132,cinder:UPDATE=174,cinder:INSERT=47,cinder:DELETE=19 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:00:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba323aa3-672f-4197-9ddd-1d537afe0f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48d6bcb9-366b-431d-87ca-18493c48aed1', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:39 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-433609a3-38dc-479e-b7b9-a8dadf8aeb67 1073741824 Jul 10 05:00:39 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0452b8f1-f926-4610-9840-e4d58b75d99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:39 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Volume volume-48d6bcb9-366b-431d-87ca-18493c48aed1 (48d6bcb9-366b-431d-87ca-18493c48aed1): created successfully Jul 10 05:00:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0452b8f1-f926-4610-9840-e4d58b75d99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Flow 'volume_create_manager' (6e2fabbf-a964-493e-8fa1-80a884e542fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:39 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-6fb9dabd-4a7a-4905-9627-538a20f372af tempest-ProjectReaderTests-849381127 None] Created volume successfully. Jul 10 05:00:40 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-433609a3-38dc-479e-b7b9-a8dadf8aeb67 1073741824" returned: 0 in 0.958s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a27bf855-b368-4489-9dca-770876aefdeb tempest-ProjectReaderTests-849381127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-433609a3-38dc-479e-b7b9-a8dadf8aeb67 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:40 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-433609a3-38dc-479e-b7b9-a8dadf8aeb67 Jul 10 05:00:40 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:40 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-433609a3-38dc-479e-b7b9-a8dadf8aeb67" returned: 0 in 0.660s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:00:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.117s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-358892603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dab1527-7679-4045-848e-554f48ac7597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec259673c5ea425ea8851c25df3aea28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:37Z,use_quota=True,user_id='328e21bca6184440b65ac09955c74751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Creating volume 3dab1527-7679-4045-848e-554f48ac7597 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:00:41 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dab1527-7679-4045-848e-554f48ac7597 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8bc5b0-73e8-4172-b2f9-188ef6f582bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-433609a3-38dc-479e-b7b9-a8dadf8aeb67', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:41 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dab1527-7679-4045-848e-554f48ac7597 1073741824 Jul 10 05:00:41 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44443cd0-5a37-4720-975b-5a3714e0059a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:41 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Volume volume-433609a3-38dc-479e-b7b9-a8dadf8aeb67 (433609a3-38dc-479e-b7b9-a8dadf8aeb67): created successfully Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44443cd0-5a37-4720-975b-5a3714e0059a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Flow 'volume_create_manager' (2a259058-6137-499f-8d28-d2837fa16bb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:41 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a5ea5108-15a0-4b45-80ed-88562ffa4da4 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Created volume successfully. Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Flow 'volume_create_manager' (42ee243e-3017-4a89-be89-875744eaa348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf990384-8d8d-4f03-be5f-fe7dae2a1de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf990384-8d8d-4f03-be5f-fe7dae2a1de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1344361516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=262d66b5-fd52-46e7-ac3b-dff909d324e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75527e34ed804052a0fadefec6ad0256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:42Z,use_quota=True,user_id='5f3936dd824843ac97c398ea051995e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ee8fc9-c1f8-409f-abf4-bb1ee95d42d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ee8fc9-c1f8-409f-abf4-bb1ee95d42d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75dd5de0-1375-4ac8-997c-5e7b9b00cbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75dd5de0-1375-4ac8-997c-5e7b9b00cbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '262d66b5-fd52-46e7-ac3b-dff909d324e6', 'volume_name': 'volume-262d66b5-fd52-46e7-ac3b-dff909d324e6', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8731c2f2-d500-476d-836a-9f75c1668885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8731c2f2-d500-476d-836a-9f75c1668885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a71859-cc8b-4daf-b85f-ab459ce54ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:41 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Volume 262d66b5-fd52-46e7-ac3b-dff909d324e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-262d66b5-fd52-46e7-ac3b-dff909d324e6', 'volume_size': 1} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:41 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dab1527-7679-4045-848e-554f48ac7597 1073741824" returned: 0 in 0.849s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dab1527-7679-4045-848e-554f48ac7597 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:41 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dab1527-7679-4045-848e-554f48ac7597 Jul 10 05:00:41 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:42 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dab1527-7679-4045-848e-554f48ac7597" returned: 0 in 0.649s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:00:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.285s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1322250708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9887b461-99f5-4a2c-88b9-a35ace1c7243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec259673c5ea425ea8851c25df3aea28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:37Z,use_quota=True,user_id='328e21bca6184440b65ac09955c74751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:00:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Creating volume 9887b461-99f5-4a2c-88b9-a35ace1c7243 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:00:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:00:42 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:00:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9887b461-99f5-4a2c-88b9-a35ace1c7243 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:42 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9887b461-99f5-4a2c-88b9-a35ace1c7243 1073741824 Jul 10 05:00:42 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e32afb0-701b-4e5f-9ec3-9365220bdadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dab1527-7679-4045-848e-554f48ac7597', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06de411f-b8c3-4145-be53-32d9e34443b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:42 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Volume volume-3dab1527-7679-4045-848e-554f48ac7597 (3dab1527-7679-4045-848e-554f48ac7597): created successfully Jul 10 05:00:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06de411f-b8c3-4145-be53-32d9e34443b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Flow 'volume_create_manager' (daf9105e-cbc4-4a82-bd71-7d1e983130de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:42 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-5b4d6271-2867-4e6e-8227-7184c53680fb tempest-CreateVolumesFromSnapshotTest-2076719672 None] Created volume successfully. Jul 10 05:00:43 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9887b461-99f5-4a2c-88b9-a35ace1c7243 1073741824" returned: 0 in 0.815s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9887b461-99f5-4a2c-88b9-a35ace1c7243 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:43 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9887b461-99f5-4a2c-88b9-a35ace1c7243 Jul 10 05:00:43 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:44 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9887b461-99f5-4a2c-88b9-a35ace1c7243" returned: 0 in 0.637s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:00:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.264s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-918636819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c59541-e4d6-42c6-99d4-c8d298a32884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec259673c5ea425ea8851c25df3aea28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:38Z,use_quota=True,user_id='328e21bca6184440b65ac09955c74751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:00:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Creating volume 76c59541-e4d6-42c6-99d4-c8d298a32884 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:00:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:00:44 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:00:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76c59541-e4d6-42c6-99d4-c8d298a32884 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:44 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76c59541-e4d6-42c6-99d4-c8d298a32884 1073741824 Jul 10 05:00:44 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:44 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1fecf30-d651-4252-a13c-7c7ca7cb095d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9887b461-99f5-4a2c-88b9-a35ace1c7243', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:44 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57160e4-ae55-4908-b669-277d20c9bf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:44 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Volume volume-9887b461-99f5-4a2c-88b9-a35ace1c7243 (9887b461-99f5-4a2c-88b9-a35ace1c7243): created successfully Jul 10 05:00:44 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57160e4-ae55-4908-b669-277d20c9bf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:44 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Flow 'volume_create_manager' (44cae943-c811-412b-a365-b21f8d96c942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:44 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-e6590a38-1c29-499f-8353-c1d970f73ec0 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Created volume successfully. Jul 10 05:00:44 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76c59541-e4d6-42c6-99d4-c8d298a32884 1073741824" returned: 0 in 0.822s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76c59541-e4d6-42c6-99d4-c8d298a32884 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:44 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76c59541-e4d6-42c6-99d4-c8d298a32884 Jul 10 05:00:44 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:45 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76c59541-e4d6-42c6-99d4-c8d298a32884" returned: 0 in 0.662s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:45 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:00:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.195s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:45 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2027631000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738cc5ee-56f3-4a41-b50a-dd7321069eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec259673c5ea425ea8851c25df3aea28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:38Z,use_quota=True,user_id='328e21bca6184440b65ac09955c74751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:00:45 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Creating volume 738cc5ee-56f3-4a41-b50a-dd7321069eff {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:00:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:45 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:45 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:45 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:00:45 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:00:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-738cc5ee-56f3-4a41-b50a-dd7321069eff 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:45 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-738cc5ee-56f3-4a41-b50a-dd7321069eff 1073741824 Jul 10 05:00:45 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:45 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f2dde5-d3e5-49cb-ad4e-df96d8e1afe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76c59541-e4d6-42c6-99d4-c8d298a32884', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:45 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88debe79-6fa5-4712-b24b-4d0e689d94c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:45 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Volume volume-76c59541-e4d6-42c6-99d4-c8d298a32884 (76c59541-e4d6-42c6-99d4-c8d298a32884): created successfully Jul 10 05:00:45 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88debe79-6fa5-4712-b24b-4d0e689d94c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:45 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Flow 'volume_create_manager' (4b340da5-b5d4-4649-84fc-586508ea993d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:45 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-81fe9c38-80e1-41f4-8e8a-6913d2cfa544 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Created volume successfully. Jul 10 05:00:46 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-738cc5ee-56f3-4a41-b50a-dd7321069eff 1073741824" returned: 0 in 0.827s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-738cc5ee-56f3-4a41-b50a-dd7321069eff {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:46 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-738cc5ee-56f3-4a41-b50a-dd7321069eff Jul 10 05:00:46 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:47 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-738cc5ee-56f3-4a41-b50a-dd7321069eff" returned: 0 in 0.627s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:00:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.132s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-585653769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aabfd81f-589f-437f-9c57-6bad2e20b6be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4836888160b4f80b413ee933c86b2d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:39Z,use_quota=True,user_id='34910844ae6a4b63bfe4deb7caad2468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:00:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Creating volume aabfd81f-589f-437f-9c57-6bad2e20b6be {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:00:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:00:47 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:00:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:47 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be 1073741824 Jul 10 05:00:47 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:47 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f38d6a-22de-40c7-94b5-c2c089c75f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-738cc5ee-56f3-4a41-b50a-dd7321069eff', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:47 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ede76f-b665-4639-9b45-49805196c106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:47 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Volume volume-738cc5ee-56f3-4a41-b50a-dd7321069eff (738cc5ee-56f3-4a41-b50a-dd7321069eff): created successfully Jul 10 05:00:47 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ede76f-b665-4639-9b45-49805196c106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:47 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Flow 'volume_create_manager' (063fc20c-d843-4d1b-bf24-4b6a6ac81153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:47 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-6394ed55-e70e-47d7-97c3-47be20bb3170 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Created volume successfully. Jul 10 05:00:47 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be 1073741824" returned: 0 in 0.824s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:47 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be Jul 10 05:00:47 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a91d17e7-2cfa-4daf-89e2-9a4bd279c703 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "cinder-738cc5ee-56f3-4a41-b50a-dd7321069eff-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a91d17e7-2cfa-4daf-89e2-9a4bd279c703 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-738cc5ee-56f3-4a41-b50a-dd7321069eff-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:48 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a91d17e7-2cfa-4daf-89e2-9a4bd279c703 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "cinder-quobyte-738cc5ee-56f3-4a41-b50a-dd7321069eff" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:48 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a91d17e7-2cfa-4daf-89e2-9a4bd279c703 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-quobyte-738cc5ee-56f3-4a41-b50a-dd7321069eff" acquired by "delete_volume" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:48 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15549e1-7d56-4d56-827b-6db939517dde]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a91d17e7-2cfa-4daf-89e2-9a4bd279c703 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-738cc5ee-56f3-4a41-b50a-dd7321069eff {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:48 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-738cc5ee-56f3-4a41-b50a-dd7321069eff Jul 10 05:00:48 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:48 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be" returned: 0 in 0.665s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:00:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a27bf855-b368-4489-9dca-770876aefdeb tempest-ProjectReaderTests-849381127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.306s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdea51f9-923a-48fc-a459-c790e79600af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aabfd81f-589f-437f-9c57-6bad2e20b6be', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced9ec03-aba1-4862-91e5-c05c03ad7fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a27bf855-b368-4489-9dca-770876aefdeb tempest-ProjectReaderTests-849381127 None] Creating offline snapshot 27845ccb-3a51-4311-ba98-b5c8a1563ba2 of volume 48d6bcb9-366b-431d-87ca-18493c48aed1 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:00:48 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Volume volume-aabfd81f-589f-437f-9c57-6bad2e20b6be (aabfd81f-589f-437f-9c57-6bad2e20b6be): created successfully Jul 10 05:00:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced9ec03-aba1-4862-91e5-c05c03ad7fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Flow 'volume_create_manager' (733fef6b-91c1-443d-a6b6-bb7c997bfcfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:48 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[9861ba1d-7bb6-4440-b142-be3920a6a6a7]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a27bf855-b368-4489-9dca-770876aefdeb tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:48 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-9f8f6c82-7716-4b41-b522-8fdde6689f10 tempest-CinderUnicodeTest-1487229715 None] Created volume successfully. Jul 10 05:00:48 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1 Jul 10 05:00:48 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:48 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a91d17e7-2cfa-4daf-89e2-9a4bd279c703 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-738cc5ee-56f3-4a41-b50a-dd7321069eff" returned: 0 in 0.805s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a91d17e7-2cfa-4daf-89e2-9a4bd279c703 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-738cc5ee-56f3-4a41-b50a-dd7321069eff {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:48 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-738cc5ee-56f3-4a41-b50a-dd7321069eff Jul 10 05:00:48 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:49 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a27bf855-b368-4489-9dca-770876aefdeb tempest-ProjectReaderTests-849381127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1" returned: 0 in 0.817s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a27bf855-b368-4489-9dca-770876aefdeb tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.27845ccb-3a51-4311-ba98-b5c8a1563ba2 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:49 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.27845ccb-3a51-4311-ba98-b5c8a1563ba2 1G Jul 10 05:00:49 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:49 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a91d17e7-2cfa-4daf-89e2-9a4bd279c703 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-738cc5ee-56f3-4a41-b50a-dd7321069eff" returned: 0 in 0.686s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:49 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a91d17e7-2cfa-4daf-89e2-9a4bd279c703 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-quobyte-738cc5ee-56f3-4a41-b50a-dd7321069eff" released by "delete_volume" :: held 1.536s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:49 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-a91d17e7-2cfa-4daf-89e2-9a4bd279c703 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Created reservations ['30d521fc-d33a-4645-9044-7abb28c0e68a', '9fe3ce77-4c8b-46dc-842f-f001f1211d6f', '12d835f8-ec66-4fd6-8a08-cac60272f2e8', 'dc65897b-1c2a-4f63-8e12-026e23d905b7'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:00:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2297c73c-2877-4a63-a069-4701ae0afa98 tempest-CinderUnicodeTest-1487229715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a91d17e7-2cfa-4daf-89e2-9a4bd279c703 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a91d17e7-2cfa-4daf-89e2-9a4bd279c703 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a91d17e7-2cfa-4daf-89e2-9a4bd279c703 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a91d17e7-2cfa-4daf-89e2-9a4bd279c703 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a91d17e7-2cfa-4daf-89e2-9a4bd279c703 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a91d17e7-2cfa-4daf-89e2-9a4bd279c703 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:49 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:00:49 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b35e5a33-b830-4acf-9868-cffbb2f2877e tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "cinder-76c59541-e4d6-42c6-99d4-c8d298a32884-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b35e5a33-b830-4acf-9868-cffbb2f2877e tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-76c59541-e4d6-42c6-99d4-c8d298a32884-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b35e5a33-b830-4acf-9868-cffbb2f2877e tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "cinder-quobyte-76c59541-e4d6-42c6-99d4-c8d298a32884" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b35e5a33-b830-4acf-9868-cffbb2f2877e tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-quobyte-76c59541-e4d6-42c6-99d4-c8d298a32884" acquired by "delete_volume" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:50 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a9cffa-0c1d-4065-8c9b-4b06004f1590]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b35e5a33-b830-4acf-9868-cffbb2f2877e tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76c59541-e4d6-42c6-99d4-c8d298a32884 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:50 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a91d17e7-2cfa-4daf-89e2-9a4bd279c703 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.664s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:50 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-a91d17e7-2cfa-4daf-89e2-9a4bd279c703 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:00:50 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a27bf855-b368-4489-9dca-770876aefdeb tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.27845ccb-3a51-4311-ba98-b5c8a1563ba2 1G" returned: 0 in 0.906s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a27bf855-b368-4489-9dca-770876aefdeb tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48d6bcb9-366b-431d-87ca-18493c48aed1 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.27845ccb-3a51-4311-ba98-b5c8a1563ba2 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:50 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a91d17e7-2cfa-4daf-89e2-9a4bd279c703 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Deleted volume successfully. Jul 10 05:00:50 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76c59541-e4d6-42c6-99d4-c8d298a32884 Jul 10 05:00:50 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:50 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48d6bcb9-366b-431d-87ca-18493c48aed1 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.27845ccb-3a51-4311-ba98-b5c8a1563ba2 Jul 10 05:00:50 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a91d17e7-2cfa-4daf-89e2-9a4bd279c703 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-738cc5ee-56f3-4a41-b50a-dd7321069eff-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:51 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b35e5a33-b830-4acf-9868-cffbb2f2877e tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76c59541-e4d6-42c6-99d4-c8d298a32884" returned: 0 in 0.777s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b35e5a33-b830-4acf-9868-cffbb2f2877e tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76c59541-e4d6-42c6-99d4-c8d298a32884 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:51 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76c59541-e4d6-42c6-99d4-c8d298a32884 Jul 10 05:00:51 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:51 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a27bf855-b368-4489-9dca-770876aefdeb tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48d6bcb9-366b-431d-87ca-18493c48aed1 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.27845ccb-3a51-4311-ba98-b5c8a1563ba2" returned: 0 in 0.753s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:51 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-a27bf855-b368-4489-9dca-770876aefdeb tempest-ProjectReaderTests-849381127 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.27845ccb-3a51-4311-ba98-b5c8a1563ba2 is being set with open permissions: ugo+rw Jul 10 05:00:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a27bf855-b368-4489-9dca-770876aefdeb tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.27845ccb-3a51-4311-ba98-b5c8a1563ba2 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:51 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.27845ccb-3a51-4311-ba98-b5c8a1563ba2 Jul 10 05:00:51 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:51 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b35e5a33-b830-4acf-9868-cffbb2f2877e tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-76c59541-e4d6-42c6-99d4-c8d298a32884" returned: 0 in 0.700s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b35e5a33-b830-4acf-9868-cffbb2f2877e tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-quobyte-76c59541-e4d6-42c6-99d4-c8d298a32884" released by "delete_volume" :: held 1.523s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:51 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a27bf855-b368-4489-9dca-770876aefdeb tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.27845ccb-3a51-4311-ba98-b5c8a1563ba2" returned: 0 in 0.684s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a27bf855-b368-4489-9dca-770876aefdeb tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:51 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-b35e5a33-b830-4acf-9868-cffbb2f2877e tempest-CreateVolumesFromSnapshotTest-2076719672 None] Created reservations ['773ffa62-6d61-4b9a-b5fd-899f1b96afa3', '7a7bfc6a-e5fb-4a51-a15e-c2f239a86cd6', '3ba3bb67-d374-4842-bbec-635d0acf0140', '1c644320-571d-40f9-8f08-cfc2f97ee189'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:00:51 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.info Jul 10 05:00:51 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b35e5a33-b830-4acf-9868-cffbb2f2877e tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b35e5a33-b830-4acf-9868-cffbb2f2877e tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:51 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-b35e5a33-b830-4acf-9868-cffbb2f2877e tempest-CreateVolumesFromSnapshotTest-2076719672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:51 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-b35e5a33-b830-4acf-9868-cffbb2f2877e tempest-CreateVolumesFromSnapshotTest-2076719672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-b35e5a33-b830-4acf-9868-cffbb2f2877e tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b35e5a33-b830-4acf-9868-cffbb2f2877e tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:51 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:00:51 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-737e549b-b14f-4962-9d68-d0964ef36e15 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "cinder-9887b461-99f5-4a2c-88b9-a35ace1c7243-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-737e549b-b14f-4962-9d68-d0964ef36e15 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-9887b461-99f5-4a2c-88b9-a35ace1c7243-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-737e549b-b14f-4962-9d68-d0964ef36e15 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "cinder-quobyte-9887b461-99f5-4a2c-88b9-a35ace1c7243" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-737e549b-b14f-4962-9d68-d0964ef36e15 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-quobyte-9887b461-99f5-4a2c-88b9-a35ace1c7243" acquired by "delete_volume" :: waited 0.023s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:52 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf161a2-065b-46fc-8734-9e00b6ae8b0b]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-737e549b-b14f-4962-9d68-d0964ef36e15 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9887b461-99f5-4a2c-88b9-a35ace1c7243 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:52 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a27bf855-b368-4489-9dca-770876aefdeb tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.info" returned: 0 in 0.702s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:52 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-a27bf855-b368-4489-9dca-770876aefdeb tempest-ProjectReaderTests-849381127 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.info is being set with open permissions: ugo+rw Jul 10 05:00:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a27bf855-b368-4489-9dca-770876aefdeb tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:52 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.info Jul 10 05:00:52 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:52 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9887b461-99f5-4a2c-88b9-a35ace1c7243 Jul 10 05:00:52 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:52 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b35e5a33-b830-4acf-9868-cffbb2f2877e tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.716s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:52 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-b35e5a33-b830-4acf-9868-cffbb2f2877e tempest-CreateVolumesFromSnapshotTest-2076719672 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:00:52 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-b35e5a33-b830-4acf-9868-cffbb2f2877e tempest-CreateVolumesFromSnapshotTest-2076719672 None] Deleted volume successfully. Jul 10 05:00:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b35e5a33-b830-4acf-9868-cffbb2f2877e tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-76c59541-e4d6-42c6-99d4-c8d298a32884-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:53 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a27bf855-b368-4489-9dca-770876aefdeb tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.info" returned: 0 in 0.680s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a27bf855-b368-4489-9dca-770876aefdeb tempest-ProjectReaderTests-849381127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.666s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.561s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:53 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1344361516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=262d66b5-fd52-46e7-ac3b-dff909d324e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75527e34ed804052a0fadefec6ad0256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:42Z,use_quota=True,user_id='5f3936dd824843ac97c398ea051995e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:00:53 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Creating volume 262d66b5-fd52-46e7-ac3b-dff909d324e6 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:00:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:53 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:53 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:53 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:00:53 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:00:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-262d66b5-fd52-46e7-ac3b-dff909d324e6 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:53 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-262d66b5-fd52-46e7-ac3b-dff909d324e6 1073741824 Jul 10 05:00:53 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:53 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a27bf855-b368-4489-9dca-770876aefdeb tempest-ProjectReaderTests-849381127 None] Create snapshot completed successfully Jul 10 05:00:53 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-737e549b-b14f-4962-9d68-d0964ef36e15 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9887b461-99f5-4a2c-88b9-a35ace1c7243" returned: 0 in 0.807s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-737e549b-b14f-4962-9d68-d0964ef36e15 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9887b461-99f5-4a2c-88b9-a35ace1c7243 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:53 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9887b461-99f5-4a2c-88b9-a35ace1c7243 Jul 10 05:00:53 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b47e6564-2cff-423e-a743-a0546e8ffeea tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-27845ccb-3a51-4311-ba98-b5c8a1563ba2-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b47e6564-2cff-423e-a743-a0546e8ffeea tempest-ProjectReaderTests-849381127 None] Lock "cinder-27845ccb-3a51-4311-ba98-b5c8a1563ba2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b47e6564-2cff-423e-a743-a0546e8ffeea tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-quobyte-48d6bcb9-366b-431d-87ca-18493c48aed1" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b47e6564-2cff-423e-a743-a0546e8ffeea tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-48d6bcb9-366b-431d-87ca-18493c48aed1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b47e6564-2cff-423e-a743-a0546e8ffeea tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-quobyte-27845ccb-3a51-4311-ba98-b5c8a1563ba2" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b47e6564-2cff-423e-a743-a0546e8ffeea tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-27845ccb-3a51-4311-ba98-b5c8a1563ba2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-b47e6564-2cff-423e-a743-a0546e8ffeea tempest-ProjectReaderTests-849381127 None] Deleting offline snapshot 27845ccb-3a51-4311-ba98-b5c8a1563ba2 of volume 48d6bcb9-366b-431d-87ca-18493c48aed1 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-b47e6564-2cff-423e-a743-a0546e8ffeea tempest-ProjectReaderTests-849381127 None] snapshot_file for this snap is: volume-48d6bcb9-366b-431d-87ca-18493c48aed1.27845ccb-3a51-4311-ba98-b5c8a1563ba2 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[31402033-6c85-4c11-84a3-25a7a43d0499]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b47e6564-2cff-423e-a743-a0546e8ffeea tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.27845ccb-3a51-4311-ba98-b5c8a1563ba2 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:54 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-737e549b-b14f-4962-9d68-d0964ef36e15 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-9887b461-99f5-4a2c-88b9-a35ace1c7243" returned: 0 in 0.726s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-737e549b-b14f-4962-9d68-d0964ef36e15 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-quobyte-9887b461-99f5-4a2c-88b9-a35ace1c7243" released by "delete_volume" :: held 1.580s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-737e549b-b14f-4962-9d68-d0964ef36e15 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Created reservations ['749b3a2d-1b60-4a80-8a90-78e201733be3', '1908266b-deea-42e7-a931-3a08093672f6', '1b7bf976-bdf6-4baa-8f39-73ba39d9889d', '748c2406-e5d2-42c8-8846-303e9757405d'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:00:54 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.27845ccb-3a51-4311-ba98-b5c8a1563ba2 Jul 10 05:00:54 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:54 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-737e549b-b14f-4962-9d68-d0964ef36e15 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-737e549b-b14f-4962-9d68-d0964ef36e15 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-737e549b-b14f-4962-9d68-d0964ef36e15 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-737e549b-b14f-4962-9d68-d0964ef36e15 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-737e549b-b14f-4962-9d68-d0964ef36e15 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-737e549b-b14f-4962-9d68-d0964ef36e15 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-262d66b5-fd52-46e7-ac3b-dff909d324e6 1073741824" returned: 0 in 0.948s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:54 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:00:54 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-262d66b5-fd52-46e7-ac3b-dff909d324e6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:54 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-262d66b5-fd52-46e7-ac3b-dff909d324e6 Jul 10 05:00:54 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-767aa9a3-28c1-4ab9-a1c1-da6542586d17 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "cinder-3dab1527-7679-4045-848e-554f48ac7597-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-767aa9a3-28c1-4ab9-a1c1-da6542586d17 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-3dab1527-7679-4045-848e-554f48ac7597-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-767aa9a3-28c1-4ab9-a1c1-da6542586d17 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "cinder-quobyte-3dab1527-7679-4045-848e-554f48ac7597" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-767aa9a3-28c1-4ab9-a1c1-da6542586d17 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-quobyte-3dab1527-7679-4045-848e-554f48ac7597" acquired by "delete_volume" :: waited 0.028s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c49910-a270-482b-842e-a698004724bd]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-767aa9a3-28c1-4ab9-a1c1-da6542586d17 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dab1527-7679-4045-848e-554f48ac7597 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:54 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b47e6564-2cff-423e-a743-a0546e8ffeea tempest-ProjectReaderTests-849381127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.27845ccb-3a51-4311-ba98-b5c8a1563ba2" returned: 0 in 0.862s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-b47e6564-2cff-423e-a743-a0546e8ffeea tempest-ProjectReaderTests-849381127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48d6bcb9-366b-431d-87ca-18493c48aed1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:00:54 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dab1527-7679-4045-848e-554f48ac7597 Jul 10 05:00:54 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f342b3d-38dc-4c16-9076-b1976ea3033e]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b47e6564-2cff-423e-a743-a0546e8ffeea tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:54 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-737e549b-b14f-4962-9d68-d0964ef36e15 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.754s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:54 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-737e549b-b14f-4962-9d68-d0964ef36e15 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:00:55 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-737e549b-b14f-4962-9d68-d0964ef36e15 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Deleted volume successfully. Jul 10 05:00:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-737e549b-b14f-4962-9d68-d0964ef36e15 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-9887b461-99f5-4a2c-88b9-a35ace1c7243-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:55 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-262d66b5-fd52-46e7-ac3b-dff909d324e6" returned: 0 in 0.781s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:00:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2297c73c-2877-4a63-a069-4701ae0afa98 tempest-CinderUnicodeTest-1487229715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.367s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:55 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1 Jul 10 05:00:55 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:55 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a71859-cc8b-4daf-b85f-ab459ce54ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-262d66b5-fd52-46e7-ac3b-dff909d324e6', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:55 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b11101-665f-4246-8edd-90eaf5ea2eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-2297c73c-2877-4a63-a069-4701ae0afa98 tempest-CinderUnicodeTest-1487229715 None] Creating offline snapshot 3dec4f58-5dd6-4095-a9c9-99bbce20a7dc of volume aabfd81f-589f-437f-9c57-6bad2e20b6be {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:00:55 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Volume volume-262d66b5-fd52-46e7-ac3b-dff909d324e6 (262d66b5-fd52-46e7-ac3b-dff909d324e6): created successfully Jul 10 05:00:55 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b11101-665f-4246-8edd-90eaf5ea2eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:55 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Flow 'volume_create_manager' (42ee243e-3017-4a89-be89-875744eaa348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:55 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4ea721-e300-4976-bb58-d9233af5ac9d]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2297c73c-2877-4a63-a069-4701ae0afa98 tempest-CinderUnicodeTest-1487229715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:55 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-3209158f-dc21-49f7-83e0-6444a11147d8 tempest-ProjectReaderTests-1866015767 None] Created volume successfully. Jul 10 05:00:55 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be Jul 10 05:00:55 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f9bbf1cb-9c34-4487-9626-7fa6219b9698 tempest-ProjectReaderTests-1866015767 None] Acquiring lock "cinder-262d66b5-fd52-46e7-ac3b-dff909d324e6-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f9bbf1cb-9c34-4487-9626-7fa6219b9698 tempest-ProjectReaderTests-1866015767 None] Lock "cinder-262d66b5-fd52-46e7-ac3b-dff909d324e6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f9bbf1cb-9c34-4487-9626-7fa6219b9698 tempest-ProjectReaderTests-1866015767 None] Acquiring lock "cinder-quobyte-262d66b5-fd52-46e7-ac3b-dff909d324e6" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f9bbf1cb-9c34-4487-9626-7fa6219b9698 tempest-ProjectReaderTests-1866015767 None] Lock "cinder-quobyte-262d66b5-fd52-46e7-ac3b-dff909d324e6" acquired by "delete_volume" :: waited 0.023s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:55 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2163b7-9cdb-406e-b3f8-c75bfcff352e]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f9bbf1cb-9c34-4487-9626-7fa6219b9698 tempest-ProjectReaderTests-1866015767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-262d66b5-fd52-46e7-ac3b-dff909d324e6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:55 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-767aa9a3-28c1-4ab9-a1c1-da6542586d17 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dab1527-7679-4045-848e-554f48ac7597" returned: 0 in 0.942s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-767aa9a3-28c1-4ab9-a1c1-da6542586d17 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dab1527-7679-4045-848e-554f48ac7597 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:55 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dab1527-7679-4045-848e-554f48ac7597 Jul 10 05:00:55 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:55 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-262d66b5-fd52-46e7-ac3b-dff909d324e6 Jul 10 05:00:55 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:55 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b47e6564-2cff-423e-a743-a0546e8ffeea tempest-ProjectReaderTests-849381127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1" returned: 0 in 1.015s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b47e6564-2cff-423e-a743-a0546e8ffeea tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.27845ccb-3a51-4311-ba98-b5c8a1563ba2 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:56 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.27845ccb-3a51-4311-ba98-b5c8a1563ba2 Jul 10 05:00:56 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:56 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2297c73c-2877-4a63-a069-4701ae0afa98 tempest-CinderUnicodeTest-1487229715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be" returned: 0 in 0.861s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2297c73c-2877-4a63-a069-4701ae0afa98 tempest-CinderUnicodeTest-1487229715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.3dec4f58-5dd6-4095-a9c9-99bbce20a7dc 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:56 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.3dec4f58-5dd6-4095-a9c9-99bbce20a7dc 1G Jul 10 05:00:56 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:56 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-767aa9a3-28c1-4ab9-a1c1-da6542586d17 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-3dab1527-7679-4045-848e-554f48ac7597" returned: 0 in 0.754s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-767aa9a3-28c1-4ab9-a1c1-da6542586d17 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-quobyte-3dab1527-7679-4045-848e-554f48ac7597" released by "delete_volume" :: held 1.747s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:56 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-767aa9a3-28c1-4ab9-a1c1-da6542586d17 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Created reservations ['8504003d-1276-40b0-b7da-26da89a866df', 'd035e616-fb76-4d6c-ae9e-31c89a0a9681', 'f4557f46-c57c-4f44-bc69-1e3e66cf5b6b', '4efa221f-8d9d-4f3a-9eff-bfbf1c8193b2'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:00:56 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f9bbf1cb-9c34-4487-9626-7fa6219b9698 tempest-ProjectReaderTests-1866015767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-262d66b5-fd52-46e7-ac3b-dff909d324e6" returned: 0 in 0.889s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f9bbf1cb-9c34-4487-9626-7fa6219b9698 tempest-ProjectReaderTests-1866015767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-262d66b5-fd52-46e7-ac3b-dff909d324e6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:56 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-262d66b5-fd52-46e7-ac3b-dff909d324e6 Jul 10 05:00:56 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-767aa9a3-28c1-4ab9-a1c1-da6542586d17 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-767aa9a3-28c1-4ab9-a1c1-da6542586d17 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-767aa9a3-28c1-4ab9-a1c1-da6542586d17 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-767aa9a3-28c1-4ab9-a1c1-da6542586d17 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-767aa9a3-28c1-4ab9-a1c1-da6542586d17 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-767aa9a3-28c1-4ab9-a1c1-da6542586d17 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:56 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:00:56 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:56 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b47e6564-2cff-423e-a743-a0546e8ffeea tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.27845ccb-3a51-4311-ba98-b5c8a1563ba2" returned: 0 in 0.855s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b47e6564-2cff-423e-a743-a0546e8ffeea tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.27845ccb-3a51-4311-ba98-b5c8a1563ba2 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:56 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.27845ccb-3a51-4311-ba98-b5c8a1563ba2 Jul 10 05:00:56 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:56 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2297c73c-2877-4a63-a069-4701ae0afa98 tempest-CinderUnicodeTest-1487229715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.3dec4f58-5dd6-4095-a9c9-99bbce20a7dc 1G" returned: 0 in 0.989s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2297c73c-2877-4a63-a069-4701ae0afa98 tempest-CinderUnicodeTest-1487229715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aabfd81f-589f-437f-9c57-6bad2e20b6be -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.3dec4f58-5dd6-4095-a9c9-99bbce20a7dc {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:57 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aabfd81f-589f-437f-9c57-6bad2e20b6be -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.3dec4f58-5dd6-4095-a9c9-99bbce20a7dc Jul 10 05:00:57 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9a540f60-ad8f-4c8a-99d1-b56f36ed5f64 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "cinder-433609a3-38dc-479e-b7b9-a8dadf8aeb67-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9a540f60-ad8f-4c8a-99d1-b56f36ed5f64 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-433609a3-38dc-479e-b7b9-a8dadf8aeb67-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9a540f60-ad8f-4c8a-99d1-b56f36ed5f64 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "cinder-quobyte-433609a3-38dc-479e-b7b9-a8dadf8aeb67" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9a540f60-ad8f-4c8a-99d1-b56f36ed5f64 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-quobyte-433609a3-38dc-479e-b7b9-a8dadf8aeb67" acquired by "delete_volume" :: waited 0.027s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[7625cd54-9175-4275-9c51-5960179bbb91]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9a540f60-ad8f-4c8a-99d1-b56f36ed5f64 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-433609a3-38dc-479e-b7b9-a8dadf8aeb67 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:57 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-433609a3-38dc-479e-b7b9-a8dadf8aeb67 Jul 10 05:00:57 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:57 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f9bbf1cb-9c34-4487-9626-7fa6219b9698 tempest-ProjectReaderTests-1866015767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-262d66b5-fd52-46e7-ac3b-dff909d324e6" returned: 0 in 0.889s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f9bbf1cb-9c34-4487-9626-7fa6219b9698 tempest-ProjectReaderTests-1866015767 None] Lock "cinder-quobyte-262d66b5-fd52-46e7-ac3b-dff909d324e6" released by "delete_volume" :: held 1.830s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:57 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-f9bbf1cb-9c34-4487-9626-7fa6219b9698 tempest-ProjectReaderTests-1866015767 None] Created reservations ['c1a17985-05c9-4d00-8da2-03e0a3fc6c7d', 'f24bc4e7-a749-42f2-ac9c-058a72309f50', '3360bf24-a0ac-424b-85bd-bc1358dc9d9c', '3d75f4f2-3b59-4801-a86c-535828ce86d7'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-767aa9a3-28c1-4ab9-a1c1-da6542586d17 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.902s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-767aa9a3-28c1-4ab9-a1c1-da6542586d17 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:00:57 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-767aa9a3-28c1-4ab9-a1c1-da6542586d17 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Deleted volume successfully. Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-767aa9a3-28c1-4ab9-a1c1-da6542586d17 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-3dab1527-7679-4045-848e-554f48ac7597-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:57 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b47e6564-2cff-423e-a743-a0546e8ffeea tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1.27845ccb-3a51-4311-ba98-b5c8a1563ba2" returned: 0 in 0.845s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b47e6564-2cff-423e-a743-a0546e8ffeea tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-27845ccb-3a51-4311-ba98-b5c8a1563ba2" released by "_delete_snapshot" :: held 3.701s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b47e6564-2cff-423e-a743-a0546e8ffeea tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-48d6bcb9-366b-431d-87ca-18493c48aed1" released by "delete_snapshot" :: held 3.737s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f9bbf1cb-9c34-4487-9626-7fa6219b9698 tempest-ProjectReaderTests-1866015767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f9bbf1cb-9c34-4487-9626-7fa6219b9698 tempest-ProjectReaderTests-1866015767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f9bbf1cb-9c34-4487-9626-7fa6219b9698 tempest-ProjectReaderTests-1866015767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f9bbf1cb-9c34-4487-9626-7fa6219b9698 tempest-ProjectReaderTests-1866015767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f9bbf1cb-9c34-4487-9626-7fa6219b9698 tempest-ProjectReaderTests-1866015767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f9bbf1cb-9c34-4487-9626-7fa6219b9698 tempest-ProjectReaderTests-1866015767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:57 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:00:57 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-b47e6564-2cff-423e-a743-a0546e8ffeea tempest-ProjectReaderTests-849381127 None] Created reservations ['9d2a48c0-6f69-4248-b67c-36a5d496dd97', '7b522d62-2382-40aa-8ea2-c6e1dc284f46', '46e3d6d1-a306-44f8-aaf4-1559a233388a', 'a6008656-d009-445b-87ca-84eac60555b3'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:00:57 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-b47e6564-2cff-423e-a743-a0546e8ffeea tempest-ProjectReaderTests-849381127 None] Delete snapshot completed successfully. Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b47e6564-2cff-423e-a743-a0546e8ffeea tempest-ProjectReaderTests-849381127 None] Lock "cinder-27845ccb-3a51-4311-ba98-b5c8a1563ba2-delete_snapshot" released by "delete_snapshot" :: held 3.914s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:57 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2297c73c-2877-4a63-a069-4701ae0afa98 tempest-CinderUnicodeTest-1487229715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aabfd81f-589f-437f-9c57-6bad2e20b6be -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.3dec4f58-5dd6-4095-a9c9-99bbce20a7dc" returned: 0 in 0.940s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:57 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-2297c73c-2877-4a63-a069-4701ae0afa98 tempest-CinderUnicodeTest-1487229715 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.3dec4f58-5dd6-4095-a9c9-99bbce20a7dc is being set with open permissions: ugo+rw Jul 10 05:00:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2297c73c-2877-4a63-a069-4701ae0afa98 tempest-CinderUnicodeTest-1487229715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.3dec4f58-5dd6-4095-a9c9-99bbce20a7dc {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:57 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.3dec4f58-5dd6-4095-a9c9-99bbce20a7dc Jul 10 05:00:57 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-42e6c560-61f5-48c1-8e77-af251a8c2130 tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-48d6bcb9-366b-431d-87ca-18493c48aed1-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-42e6c560-61f5-48c1-8e77-af251a8c2130 tempest-ProjectReaderTests-849381127 None] Lock "cinder-48d6bcb9-366b-431d-87ca-18493c48aed1-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:58 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9a540f60-ad8f-4c8a-99d1-b56f36ed5f64 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-433609a3-38dc-479e-b7b9-a8dadf8aeb67" returned: 0 in 1.149s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9a540f60-ad8f-4c8a-99d1-b56f36ed5f64 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-433609a3-38dc-479e-b7b9-a8dadf8aeb67 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:58 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-433609a3-38dc-479e-b7b9-a8dadf8aeb67 Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-42e6c560-61f5-48c1-8e77-af251a8c2130 tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-quobyte-48d6bcb9-366b-431d-87ca-18493c48aed1" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:58 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-42e6c560-61f5-48c1-8e77-af251a8c2130 tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-48d6bcb9-366b-431d-87ca-18493c48aed1" acquired by "delete_volume" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[8488df08-c5a7-4ac6-92be-bb6bbdf89011]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-42e6c560-61f5-48c1-8e77-af251a8c2130 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Flow 'volume_create_manager' (58a6d9a1-4448-449c-b2f9-15910809267f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea3ec7e-bb30-413b-9aae-e3a51f28eab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea3ec7e-bb30-413b-9aae-e3a51f28eab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892661629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea7a2f5-7120-475c-8309-57db02183fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75527e34ed804052a0fadefec6ad0256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:59Z,use_quota=True,user_id='5f3936dd824843ac97c398ea051995e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80da9bc6-e5f6-4b72-8629-d1476fd94b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80da9bc6-e5f6-4b72-8629-d1476fd94b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b62960-fe33-49c9-ba61-2375deaf35d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b62960-fe33-49c9-ba61-2375deaf35d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ea7a2f5-7120-475c-8309-57db02183fba', 'volume_name': 'volume-7ea7a2f5-7120-475c-8309-57db02183fba', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b541d6b8-bfb3-475a-8be2-6bd9888fb7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b541d6b8-bfb3-475a-8be2-6bd9888fb7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba0e035-0a8c-484e-835f-e0ef2b2d40ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:00:58 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Volume 7ea7a2f5-7120-475c-8309-57db02183fba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ea7a2f5-7120-475c-8309-57db02183fba', 'volume_size': 1} Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:58 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1 Jul 10 05:00:58 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:58 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f9bbf1cb-9c34-4487-9626-7fa6219b9698 tempest-ProjectReaderTests-1866015767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.017s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-f9bbf1cb-9c34-4487-9626-7fa6219b9698 tempest-ProjectReaderTests-1866015767 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:00:58 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-f9bbf1cb-9c34-4487-9626-7fa6219b9698 tempest-ProjectReaderTests-1866015767 None] Deleted volume successfully. Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f9bbf1cb-9c34-4487-9626-7fa6219b9698 tempest-ProjectReaderTests-1866015767 None] Lock "cinder-262d66b5-fd52-46e7-ac3b-dff909d324e6-delete_volume" released by "delete_volume" :: held 3.167s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:58 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2297c73c-2877-4a63-a069-4701ae0afa98 tempest-CinderUnicodeTest-1487229715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.3dec4f58-5dd6-4095-a9c9-99bbce20a7dc" returned: 0 in 0.906s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2297c73c-2877-4a63-a069-4701ae0afa98 tempest-CinderUnicodeTest-1487229715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:58 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.info Jul 10 05:00:58 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:59 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9a540f60-ad8f-4c8a-99d1-b56f36ed5f64 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-433609a3-38dc-479e-b7b9-a8dadf8aeb67" returned: 0 in 0.778s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9a540f60-ad8f-4c8a-99d1-b56f36ed5f64 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-quobyte-433609a3-38dc-479e-b7b9-a8dadf8aeb67" released by "delete_volume" :: held 1.986s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-9a540f60-ad8f-4c8a-99d1-b56f36ed5f64 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Created reservations ['16c755b3-ff99-46f0-939a-c41f554d8a34', 'af1b0c2a-1a00-458b-aaf2-c23605087c9d', 'ca30f96d-cbcb-403a-9ed8-4294937ff74b', '6adb5cf0-b843-4533-8cf7-8320cea09daf'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9a540f60-ad8f-4c8a-99d1-b56f36ed5f64 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9a540f60-ad8f-4c8a-99d1-b56f36ed5f64 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9a540f60-ad8f-4c8a-99d1-b56f36ed5f64 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9a540f60-ad8f-4c8a-99d1-b56f36ed5f64 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9a540f60-ad8f-4c8a-99d1-b56f36ed5f64 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9a540f60-ad8f-4c8a-99d1-b56f36ed5f64 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:59 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:00:59 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:59 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-42e6c560-61f5-48c1-8e77-af251a8c2130 tempest-ProjectReaderTests-849381127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1" returned: 0 in 0.877s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-42e6c560-61f5-48c1-8e77-af251a8c2130 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:59 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1 Jul 10 05:00:59 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e0a554fe-9641-4ce5-949c-dc8c55f971af tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "cinder-db46d498-02ae-4233-a36f-979a06e9b112-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e0a554fe-9641-4ce5-949c-dc8c55f971af tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-db46d498-02ae-4233-a36f-979a06e9b112-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e0a554fe-9641-4ce5-949c-dc8c55f971af tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "cinder-quobyte-c42b61bb-0d38-4cba-b937-1112281116c5" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e0a554fe-9641-4ce5-949c-dc8c55f971af tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-quobyte-c42b61bb-0d38-4cba-b937-1112281116c5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e0a554fe-9641-4ce5-949c-dc8c55f971af tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "cinder-quobyte-db46d498-02ae-4233-a36f-979a06e9b112" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e0a554fe-9641-4ce5-949c-dc8c55f971af tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-quobyte-db46d498-02ae-4233-a36f-979a06e9b112" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-e0a554fe-9641-4ce5-949c-dc8c55f971af tempest-CreateVolumesFromSnapshotTest-2076719672 None] Deleting offline snapshot db46d498-02ae-4233-a36f-979a06e9b112 of volume c42b61bb-0d38-4cba-b937-1112281116c5 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-e0a554fe-9641-4ce5-949c-dc8c55f971af tempest-CreateVolumesFromSnapshotTest-2076719672 None] snapshot_file for this snap is: volume-c42b61bb-0d38-4cba-b937-1112281116c5.db46d498-02ae-4233-a36f-979a06e9b112 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[31589f8e-2e90-42bc-aece-31f81f5aa4b8]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e0a554fe-9641-4ce5-949c-dc8c55f971af tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.db46d498-02ae-4233-a36f-979a06e9b112 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:59 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2297c73c-2877-4a63-a069-4701ae0afa98 tempest-CinderUnicodeTest-1487229715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.info" returned: 0 in 0.804s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:00:59 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-2297c73c-2877-4a63-a069-4701ae0afa98 tempest-CinderUnicodeTest-1487229715 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.info is being set with open permissions: ugo+rw Jul 10 05:00:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2297c73c-2877-4a63-a069-4701ae0afa98 tempest-CinderUnicodeTest-1487229715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:00:59 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.db46d498-02ae-4233-a36f-979a06e9b112 Jul 10 05:00:59 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:00:59 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.info Jul 10 05:00:59 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:00 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9a540f60-ad8f-4c8a-99d1-b56f36ed5f64 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.813s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-9a540f60-ad8f-4c8a-99d1-b56f36ed5f64 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:01:00 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-9a540f60-ad8f-4c8a-99d1-b56f36ed5f64 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Deleted volume successfully. Jul 10 05:01:00 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9a540f60-ad8f-4c8a-99d1-b56f36ed5f64 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-433609a3-38dc-479e-b7b9-a8dadf8aeb67-delete_volume" released by "delete_volume" :: held 3.072s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-42e6c560-61f5-48c1-8e77-af251a8c2130 tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-48d6bcb9-366b-431d-87ca-18493c48aed1" returned: 0 in 0.763s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-42e6c560-61f5-48c1-8e77-af251a8c2130 tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-48d6bcb9-366b-431d-87ca-18493c48aed1" released by "delete_volume" :: held 1.739s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-42e6c560-61f5-48c1-8e77-af251a8c2130 tempest-ProjectReaderTests-849381127 None] Created reservations ['30e728aa-64bc-497a-bf28-8fea06cdadc4', '4cd0e5de-b7ff-4723-8d1e-b4e3cf4cf40e', '069ae970-c36f-4e5c-8c36-281e1a1b8593', '56742cd1-0148-4d26-8459-d1d9a16c02c8'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-42e6c560-61f5-48c1-8e77-af251a8c2130 tempest-ProjectReaderTests-849381127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-42e6c560-61f5-48c1-8e77-af251a8c2130 tempest-ProjectReaderTests-849381127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-42e6c560-61f5-48c1-8e77-af251a8c2130 tempest-ProjectReaderTests-849381127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-42e6c560-61f5-48c1-8e77-af251a8c2130 tempest-ProjectReaderTests-849381127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-42e6c560-61f5-48c1-8e77-af251a8c2130 tempest-ProjectReaderTests-849381127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-42e6c560-61f5-48c1-8e77-af251a8c2130 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:00 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:01:00 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:00 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e0a554fe-9641-4ce5-949c-dc8c55f971af tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.db46d498-02ae-4233-a36f-979a06e9b112" returned: 0 in 0.823s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-e0a554fe-9641-4ce5-949c-dc8c55f971af tempest-CreateVolumesFromSnapshotTest-2076719672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c42b61bb-0d38-4cba-b937-1112281116c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a23bb57-84d4-4ad8-89e0-841711e2e796]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e0a554fe-9641-4ce5-949c-dc8c55f971af tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:00 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2297c73c-2877-4a63-a069-4701ae0afa98 tempest-CinderUnicodeTest-1487229715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.info" returned: 0 in 0.781s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2297c73c-2877-4a63-a069-4701ae0afa98 tempest-CinderUnicodeTest-1487229715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.412s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.824s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892661629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea7a2f5-7120-475c-8309-57db02183fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75527e34ed804052a0fadefec6ad0256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:00:59Z,use_quota=True,user_id='5f3936dd824843ac97c398ea051995e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Creating volume 7ea7a2f5-7120-475c-8309-57db02183fba {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:01:00 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:01:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7ea7a2f5-7120-475c-8309-57db02183fba 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:00 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7ea7a2f5-7120-475c-8309-57db02183fba 1073741824 Jul 10 05:01:00 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:00 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-2297c73c-2877-4a63-a069-4701ae0afa98 tempest-CinderUnicodeTest-1487229715 None] Create snapshot completed successfully Jul 10 05:01:00 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5 Jul 10 05:01:00 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:01 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-42e6c560-61f5-48c1-8e77-af251a8c2130 tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.861s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-42e6c560-61f5-48c1-8e77-af251a8c2130 tempest-ProjectReaderTests-849381127 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:01:01 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-42e6c560-61f5-48c1-8e77-af251a8c2130 tempest-ProjectReaderTests-849381127 None] Deleted volume successfully. Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Flow 'volume_create_manager' (1c0a8553-c6fe-4f18-b298-6360f48142f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85607734-b8a6-463b-9367-74d5d17296f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85607734-b8a6-463b-9367-74d5d17296f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-916058550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3197eac694784dd6bff647edd9e49582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:01:01Z,use_quota=True,user_id='4abcde3dd0b34fba8f492d431f7a7696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b635063b-106d-4e62-92b5-f5b9a4d2aba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b635063b-106d-4e62-92b5-f5b9a4d2aba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9243a2d4-3cc7-47e7-a85f-a94ce717a8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9243a2d4-3cc7-47e7-a85f-a94ce717a8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5', 'volume_name': 'volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d910aaf4-c97a-484d-a9bb-569a239b8735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d910aaf4-c97a-484d-a9bb-569a239b8735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee2ba9c1-da58-4b96-b25c-12b614932e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:01 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Volume e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5', 'volume_size': 1} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b103669d-6446-44ec-ac73-d827337c9266 tempest-CinderUnicodeTest-1487229715 None] Acquiring lock "cinder-3dec4f58-5dd6-4095-a9c9-99bbce20a7dc-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-42e6c560-61f5-48c1-8e77-af251a8c2130 tempest-ProjectReaderTests-849381127 None] Lock "cinder-48d6bcb9-366b-431d-87ca-18493c48aed1-delete_volume" released by "delete_volume" :: held 3.018s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b103669d-6446-44ec-ac73-d827337c9266 tempest-CinderUnicodeTest-1487229715 None] Lock "cinder-3dec4f58-5dd6-4095-a9c9-99bbce20a7dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b103669d-6446-44ec-ac73-d827337c9266 tempest-CinderUnicodeTest-1487229715 None] Acquiring lock "cinder-quobyte-aabfd81f-589f-437f-9c57-6bad2e20b6be" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b103669d-6446-44ec-ac73-d827337c9266 tempest-CinderUnicodeTest-1487229715 None] Lock "cinder-quobyte-aabfd81f-589f-437f-9c57-6bad2e20b6be" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b103669d-6446-44ec-ac73-d827337c9266 tempest-CinderUnicodeTest-1487229715 None] Acquiring lock "cinder-quobyte-3dec4f58-5dd6-4095-a9c9-99bbce20a7dc" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b103669d-6446-44ec-ac73-d827337c9266 tempest-CinderUnicodeTest-1487229715 None] Lock "cinder-quobyte-3dec4f58-5dd6-4095-a9c9-99bbce20a7dc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-b103669d-6446-44ec-ac73-d827337c9266 tempest-CinderUnicodeTest-1487229715 None] Deleting offline snapshot 3dec4f58-5dd6-4095-a9c9-99bbce20a7dc of volume aabfd81f-589f-437f-9c57-6bad2e20b6be {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-b103669d-6446-44ec-ac73-d827337c9266 tempest-CinderUnicodeTest-1487229715 None] snapshot_file for this snap is: volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.3dec4f58-5dd6-4095-a9c9-99bbce20a7dc {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:01:01 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e0a554fe-9641-4ce5-949c-dc8c55f971af tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5" returned: 0 in 1.003s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e0a554fe-9641-4ce5-949c-dc8c55f971af tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.db46d498-02ae-4233-a36f-979a06e9b112 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[72295c64-6a11-4de4-89a6-23037ffb4d6f]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b103669d-6446-44ec-ac73-d827337c9266 tempest-CinderUnicodeTest-1487229715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.3dec4f58-5dd6-4095-a9c9-99bbce20a7dc {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:01 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.db46d498-02ae-4233-a36f-979a06e9b112 Jul 10 05:01:01 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:01 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7ea7a2f5-7120-475c-8309-57db02183fba 1073741824" returned: 0 in 0.990s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7ea7a2f5-7120-475c-8309-57db02183fba {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:01 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7ea7a2f5-7120-475c-8309-57db02183fba Jul 10 05:01:01 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:01 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.3dec4f58-5dd6-4095-a9c9-99bbce20a7dc Jul 10 05:01:01 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:02 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e0a554fe-9641-4ce5-949c-dc8c55f971af tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.db46d498-02ae-4233-a36f-979a06e9b112" returned: 0 in 0.764s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e0a554fe-9641-4ce5-949c-dc8c55f971af tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.db46d498-02ae-4233-a36f-979a06e9b112 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:02 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.db46d498-02ae-4233-a36f-979a06e9b112 Jul 10 05:01:02 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:02 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7ea7a2f5-7120-475c-8309-57db02183fba" returned: 0 in 0.709s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.916s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-916058550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3197eac694784dd6bff647edd9e49582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:01:01Z,use_quota=True,user_id='4abcde3dd0b34fba8f492d431f7a7696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Creating volume e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:01:02 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:02 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b103669d-6446-44ec-ac73-d827337c9266 tempest-CinderUnicodeTest-1487229715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.3dec4f58-5dd6-4095-a9c9-99bbce20a7dc" returned: 0 in 0.832s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-b103669d-6446-44ec-ac73-d827337c9266 tempest-CinderUnicodeTest-1487229715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aabfd81f-589f-437f-9c57-6bad2e20b6be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:01:02 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5 1073741824 Jul 10 05:01:02 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba0e035-0a8c-484e-835f-e0ef2b2d40ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ea7a2f5-7120-475c-8309-57db02183fba', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a46c61-2a10-41a6-8d5c-e6b7423ec123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[855d0b08-61e4-4ce1-8a18-affa3ec3b65f]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b103669d-6446-44ec-ac73-d827337c9266 tempest-CinderUnicodeTest-1487229715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:02 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Volume volume-7ea7a2f5-7120-475c-8309-57db02183fba (7ea7a2f5-7120-475c-8309-57db02183fba): created successfully Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a46c61-2a10-41a6-8d5c-e6b7423ec123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Flow 'volume_create_manager' (58a6d9a1-4448-449c-b2f9-15910809267f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:01:02 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c68d6e68-46ab-4d24-99de-78d82ec8cc45 tempest-ProjectReaderTests-1866015767 None] Created volume successfully. Jul 10 05:01:02 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be Jul 10 05:01:02 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-77f6bee1-9e91-4969-8496-928f6fd9aca6 tempest-ProjectReaderTests-1866015767 None] Acquiring lock "cinder-7ea7a2f5-7120-475c-8309-57db02183fba-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-77f6bee1-9e91-4969-8496-928f6fd9aca6 tempest-ProjectReaderTests-1866015767 None] Lock "cinder-7ea7a2f5-7120-475c-8309-57db02183fba-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-77f6bee1-9e91-4969-8496-928f6fd9aca6 tempest-ProjectReaderTests-1866015767 None] Acquiring lock "cinder-quobyte-7ea7a2f5-7120-475c-8309-57db02183fba" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-77f6bee1-9e91-4969-8496-928f6fd9aca6 tempest-ProjectReaderTests-1866015767 None] Lock "cinder-quobyte-7ea7a2f5-7120-475c-8309-57db02183fba" acquired by "delete_volume" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc61cb57-18ce-4bb9-93b8-ff984f55e066]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-77f6bee1-9e91-4969-8496-928f6fd9aca6 tempest-ProjectReaderTests-1866015767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7ea7a2f5-7120-475c-8309-57db02183fba {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:02 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e0a554fe-9641-4ce5-949c-dc8c55f971af tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5.db46d498-02ae-4233-a36f-979a06e9b112" returned: 0 in 0.784s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e0a554fe-9641-4ce5-949c-dc8c55f971af tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-quobyte-db46d498-02ae-4233-a36f-979a06e9b112" released by "_delete_snapshot" :: held 3.495s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:03 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7ea7a2f5-7120-475c-8309-57db02183fba Jul 10 05:01:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e0a554fe-9641-4ce5-949c-dc8c55f971af tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-quobyte-c42b61bb-0d38-4cba-b937-1112281116c5" released by "delete_snapshot" :: held 3.533s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:03 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:03 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-e0a554fe-9641-4ce5-949c-dc8c55f971af tempest-CreateVolumesFromSnapshotTest-2076719672 None] Created reservations ['fdd18171-1db8-40f5-b586-6a5d09ac7ee0', 'c7430f32-44f6-4fb2-8b64-34f87abbbfd4', '2df6548f-247c-42f8-95cd-7fc27293c5f3', 'fc660436-50a1-42b8-9395-94c470c95190'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:01:03 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-e0a554fe-9641-4ce5-949c-dc8c55f971af tempest-CreateVolumesFromSnapshotTest-2076719672 None] Delete snapshot completed successfully. Jul 10 05:01:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e0a554fe-9641-4ce5-949c-dc8c55f971af tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-db46d498-02ae-4233-a36f-979a06e9b112-delete_snapshot" released by "delete_snapshot" :: held 3.743s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:03 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5 1073741824" returned: 0 in 0.981s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:03 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5 Jul 10 05:01:03 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:03 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b103669d-6446-44ec-ac73-d827337c9266 tempest-CinderUnicodeTest-1487229715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be" returned: 0 in 1.016s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b103669d-6446-44ec-ac73-d827337c9266 tempest-CinderUnicodeTest-1487229715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.3dec4f58-5dd6-4095-a9c9-99bbce20a7dc {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:03 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.3dec4f58-5dd6-4095-a9c9-99bbce20a7dc Jul 10 05:01:03 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:03 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-77f6bee1-9e91-4969-8496-928f6fd9aca6 tempest-ProjectReaderTests-1866015767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7ea7a2f5-7120-475c-8309-57db02183fba" returned: 0 in 0.861s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-77f6bee1-9e91-4969-8496-928f6fd9aca6 tempest-ProjectReaderTests-1866015767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7ea7a2f5-7120-475c-8309-57db02183fba {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:03 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7ea7a2f5-7120-475c-8309-57db02183fba Jul 10 05:01:03 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2cbc0be4-97d7-47ed-bfef-35be79e51361 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "cinder-c42b61bb-0d38-4cba-b937-1112281116c5-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2cbc0be4-97d7-47ed-bfef-35be79e51361 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-c42b61bb-0d38-4cba-b937-1112281116c5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2cbc0be4-97d7-47ed-bfef-35be79e51361 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "cinder-quobyte-c42b61bb-0d38-4cba-b937-1112281116c5" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2cbc0be4-97d7-47ed-bfef-35be79e51361 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-quobyte-c42b61bb-0d38-4cba-b937-1112281116c5" acquired by "delete_volume" :: waited 0.028s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0f937d-be6c-4c62-a808-3de4f500d014]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2cbc0be4-97d7-47ed-bfef-35be79e51361 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:04 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5" returned: 0 in 0.759s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee2ba9c1-da58-4b96-b25c-12b614932e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a2e370-c9ef-419e-8dd0-54f14d33e031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:04 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Volume volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5 (e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5): created successfully Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a2e370-c9ef-419e-8dd0-54f14d33e031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Flow 'volume_create_manager' (1c0a8553-c6fe-4f18-b298-6360f48142f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:01:04 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-348fa432-c1e3-47ac-976c-cb81171e10fd tempest-ProjectReaderTests-849381127 None] Created volume successfully. Jul 10 05:01:04 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5 Jul 10 05:01:04 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:04 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b103669d-6446-44ec-ac73-d827337c9266 tempest-CinderUnicodeTest-1487229715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.3dec4f58-5dd6-4095-a9c9-99bbce20a7dc" returned: 0 in 0.876s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b103669d-6446-44ec-ac73-d827337c9266 tempest-CinderUnicodeTest-1487229715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.3dec4f58-5dd6-4095-a9c9-99bbce20a7dc {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:04 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.3dec4f58-5dd6-4095-a9c9-99bbce20a7dc Jul 10 05:01:04 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5de28161-4578-4dc3-bc0f-cac7330ade7a tempest-ProjectReaderTests-849381127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5de28161-4578-4dc3-bc0f-cac7330ade7a tempest-ProjectReaderTests-849381127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-5de28161-4578-4dc3-bc0f-cac7330ade7a tempest-ProjectReaderTests-849381127 None] Creating offline snapshot 71c9d930-f686-407d-b56f-01a9fa3a112e of volume e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[98304e70-1d17-4ecf-8c62-64fb07bc1d2e]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5de28161-4578-4dc3-bc0f-cac7330ade7a tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:04 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-77f6bee1-9e91-4969-8496-928f6fd9aca6 tempest-ProjectReaderTests-1866015767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-7ea7a2f5-7120-475c-8309-57db02183fba" returned: 0 in 0.898s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-77f6bee1-9e91-4969-8496-928f6fd9aca6 tempest-ProjectReaderTests-1866015767 None] Lock "cinder-quobyte-7ea7a2f5-7120-475c-8309-57db02183fba" released by "delete_volume" :: held 1.799s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:04 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5 Jul 10 05:01:04 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-77f6bee1-9e91-4969-8496-928f6fd9aca6 tempest-ProjectReaderTests-1866015767 None] Created reservations ['5dbf853d-45d4-456b-aac1-1648207474f1', '5441ff14-2d8a-4d47-a955-95e21c9d765d', '85317a86-d08b-431f-8a87-b47ce5c7fd4c', 'edabaf26-1bfa-4773-9696-c5053075bc88'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-77f6bee1-9e91-4969-8496-928f6fd9aca6 tempest-ProjectReaderTests-1866015767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-77f6bee1-9e91-4969-8496-928f6fd9aca6 tempest-ProjectReaderTests-1866015767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-77f6bee1-9e91-4969-8496-928f6fd9aca6 tempest-ProjectReaderTests-1866015767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-77f6bee1-9e91-4969-8496-928f6fd9aca6 tempest-ProjectReaderTests-1866015767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-77f6bee1-9e91-4969-8496-928f6fd9aca6 tempest-ProjectReaderTests-1866015767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-77f6bee1-9e91-4969-8496-928f6fd9aca6 tempest-ProjectReaderTests-1866015767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:04 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:01:04 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:04 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2cbc0be4-97d7-47ed-bfef-35be79e51361 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5" returned: 0 in 0.866s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2cbc0be4-97d7-47ed-bfef-35be79e51361 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:04 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5 Jul 10 05:01:04 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:05 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-b103669d-6446-44ec-ac73-d827337c9266 tempest-CinderUnicodeTest-1487229715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be.3dec4f58-5dd6-4095-a9c9-99bbce20a7dc" returned: 0 in 0.831s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b103669d-6446-44ec-ac73-d827337c9266 tempest-CinderUnicodeTest-1487229715 None] Lock "cinder-quobyte-3dec4f58-5dd6-4095-a9c9-99bbce20a7dc" released by "_delete_snapshot" :: held 3.705s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b103669d-6446-44ec-ac73-d827337c9266 tempest-CinderUnicodeTest-1487229715 None] Lock "cinder-quobyte-aabfd81f-589f-437f-9c57-6bad2e20b6be" released by "delete_snapshot" :: held 3.735s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:05 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-b103669d-6446-44ec-ac73-d827337c9266 tempest-CinderUnicodeTest-1487229715 None] Created reservations ['d6d170fa-0924-43db-be30-ed8559d28e05', '5caeb6b5-c1df-41c1-aeb8-1ac66381fb33', 'd6588c19-0d9a-4fb1-9f54-7515f94f751b', '0c43b6c8-8a26-45e6-bcdb-7e2b9a219f48'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:01:05 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-b103669d-6446-44ec-ac73-d827337c9266 tempest-CinderUnicodeTest-1487229715 None] Delete snapshot completed successfully. Jul 10 05:01:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-b103669d-6446-44ec-ac73-d827337c9266 tempest-CinderUnicodeTest-1487229715 None] Lock "cinder-3dec4f58-5dd6-4095-a9c9-99bbce20a7dc-delete_snapshot" released by "delete_snapshot" :: held 3.983s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:05 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5de28161-4578-4dc3-bc0f-cac7330ade7a tempest-ProjectReaderTests-849381127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5" returned: 0 in 0.966s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5de28161-4578-4dc3-bc0f-cac7330ade7a tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.71c9d930-f686-407d-b56f-01a9fa3a112e 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:05 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.71c9d930-f686-407d-b56f-01a9fa3a112e 1G Jul 10 05:01:05 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c8e1fb4-8329-46d7-ae70-6023cc6bef0f tempest-CinderUnicodeTest-1487229715 None] Acquiring lock "cinder-aabfd81f-589f-437f-9c57-6bad2e20b6be-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c8e1fb4-8329-46d7-ae70-6023cc6bef0f tempest-CinderUnicodeTest-1487229715 None] Lock "cinder-aabfd81f-589f-437f-9c57-6bad2e20b6be-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c8e1fb4-8329-46d7-ae70-6023cc6bef0f tempest-CinderUnicodeTest-1487229715 None] Acquiring lock "cinder-quobyte-aabfd81f-589f-437f-9c57-6bad2e20b6be" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c8e1fb4-8329-46d7-ae70-6023cc6bef0f tempest-CinderUnicodeTest-1487229715 None] Lock "cinder-quobyte-aabfd81f-589f-437f-9c57-6bad2e20b6be" acquired by "delete_volume" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:05 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-77f6bee1-9e91-4969-8496-928f6fd9aca6 tempest-ProjectReaderTests-1866015767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.961s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:05 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-77f6bee1-9e91-4969-8496-928f6fd9aca6 tempest-ProjectReaderTests-1866015767 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:01:05 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-77f6bee1-9e91-4969-8496-928f6fd9aca6 tempest-ProjectReaderTests-1866015767 None] Deleted volume successfully. Jul 10 05:01:05 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c7884d-055a-4cdc-b40f-2e74453ce64c]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c8e1fb4-8329-46d7-ae70-6023cc6bef0f tempest-CinderUnicodeTest-1487229715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-77f6bee1-9e91-4969-8496-928f6fd9aca6 tempest-ProjectReaderTests-1866015767 None] Lock "cinder-7ea7a2f5-7120-475c-8309-57db02183fba-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:05 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2cbc0be4-97d7-47ed-bfef-35be79e51361 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-c42b61bb-0d38-4cba-b937-1112281116c5" returned: 0 in 1.018s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2cbc0be4-97d7-47ed-bfef-35be79e51361 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-quobyte-c42b61bb-0d38-4cba-b937-1112281116c5" released by "delete_volume" :: held 1.956s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:05 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be Jul 10 05:01:05 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:06 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-2cbc0be4-97d7-47ed-bfef-35be79e51361 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Created reservations ['8ced8443-0b89-46b0-8c60-c632b84e7ce0', '9ea4a763-1bb8-41f4-9860-de1acf25d906', '80c2f8c1-63f1-435e-94fa-5ca70550b94b', '581800a9-88fc-4e0b-8a04-12340bd621cf'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:01:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2cbc0be4-97d7-47ed-bfef-35be79e51361 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2cbc0be4-97d7-47ed-bfef-35be79e51361 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2cbc0be4-97d7-47ed-bfef-35be79e51361 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:01:06 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-2cbc0be4-97d7-47ed-bfef-35be79e51361 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:01:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-2cbc0be4-97d7-47ed-bfef-35be79e51361 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2cbc0be4-97d7-47ed-bfef-35be79e51361 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:06 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:01:06 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:06 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5de28161-4578-4dc3-bc0f-cac7330ade7a tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.71c9d930-f686-407d-b56f-01a9fa3a112e 1G" returned: 0 in 1.169s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5de28161-4578-4dc3-bc0f-cac7330ade7a tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.71c9d930-f686-407d-b56f-01a9fa3a112e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:06 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.71c9d930-f686-407d-b56f-01a9fa3a112e Jul 10 05:01:06 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:06 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c8e1fb4-8329-46d7-ae70-6023cc6bef0f tempest-CinderUnicodeTest-1487229715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be" returned: 0 in 0.974s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c8e1fb4-8329-46d7-ae70-6023cc6bef0f tempest-CinderUnicodeTest-1487229715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:06 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be Jul 10 05:01:06 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:06 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-2cbc0be4-97d7-47ed-bfef-35be79e51361 tempest-CreateVolumesFromSnapshotTest-2076719672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.809s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:06 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-2cbc0be4-97d7-47ed-bfef-35be79e51361 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:01:06 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-2cbc0be4-97d7-47ed-bfef-35be79e51361 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Deleted volume successfully. Jul 10 05:01:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-2cbc0be4-97d7-47ed-bfef-35be79e51361 tempest-CreateVolumesFromSnapshotTest-2076719672 None] Lock "cinder-c42b61bb-0d38-4cba-b937-1112281116c5-delete_volume" released by "delete_volume" :: held 3.116s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:07 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c8e1fb4-8329-46d7-ae70-6023cc6bef0f tempest-CinderUnicodeTest-1487229715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-aabfd81f-589f-437f-9c57-6bad2e20b6be" returned: 0 in 0.904s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:07 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c8e1fb4-8329-46d7-ae70-6023cc6bef0f tempest-CinderUnicodeTest-1487229715 None] Lock "cinder-quobyte-aabfd81f-589f-437f-9c57-6bad2e20b6be" released by "delete_volume" :: held 1.972s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:07 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:07 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-9c8e1fb4-8329-46d7-ae70-6023cc6bef0f tempest-CinderUnicodeTest-1487229715 None] Created reservations ['3bcde180-145a-4b95-89ce-fdc2ee14098c', 'd21ecd8b-148f-4ea6-a83b-1ee4dbd98b79', 'c01a9020-9bc2-48a4-b8ce-09c5bb4269fb', '9b0c1eb5-d0c8-48b8-9d7a-9ea7b2261857'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:01:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5de28161-4578-4dc3-bc0f-cac7330ade7a tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.71c9d930-f686-407d-b56f-01a9fa3a112e" returned: 0 in 1.066s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:07 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-5de28161-4578-4dc3-bc0f-cac7330ade7a tempest-ProjectReaderTests-849381127 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.71c9d930-f686-407d-b56f-01a9fa3a112e is being set with open permissions: ugo+rw Jul 10 05:01:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5de28161-4578-4dc3-bc0f-cac7330ade7a tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.71c9d930-f686-407d-b56f-01a9fa3a112e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:07 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.71c9d930-f686-407d-b56f-01a9fa3a112e Jul 10 05:01:07 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9c8e1fb4-8329-46d7-ae70-6023cc6bef0f tempest-CinderUnicodeTest-1487229715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9c8e1fb4-8329-46d7-ae70-6023cc6bef0f tempest-CinderUnicodeTest-1487229715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9c8e1fb4-8329-46d7-ae70-6023cc6bef0f tempest-CinderUnicodeTest-1487229715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:01:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-9c8e1fb4-8329-46d7-ae70-6023cc6bef0f tempest-CinderUnicodeTest-1487229715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:01:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-9c8e1fb4-8329-46d7-ae70-6023cc6bef0f tempest-CinderUnicodeTest-1487229715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c8e1fb4-8329-46d7-ae70-6023cc6bef0f tempest-CinderUnicodeTest-1487229715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:07 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:01:07 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-10995d38-9bf6-4315-9209-2ffedf6a7041 tempest-CinderUnicodeTest-1487229715 None] Acquiring lock "cinder-a578b830-a891-43ae-9446-12784658a006-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-10995d38-9bf6-4315-9209-2ffedf6a7041 tempest-CinderUnicodeTest-1487229715 None] Lock "cinder-a578b830-a891-43ae-9446-12784658a006-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-10995d38-9bf6-4315-9209-2ffedf6a7041 tempest-CinderUnicodeTest-1487229715 None] Acquiring lock "cinder-quobyte-a578b830-a891-43ae-9446-12784658a006" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-10995d38-9bf6-4315-9209-2ffedf6a7041 tempest-CinderUnicodeTest-1487229715 None] Lock "cinder-quobyte-a578b830-a891-43ae-9446-12784658a006" acquired by "delete_volume" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:08 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce170b3-67ff-4665-aa25-53e5a6fdfb8b]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-10995d38-9bf6-4315-9209-2ffedf6a7041 tempest-CinderUnicodeTest-1487229715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a578b830-a891-43ae-9446-12784658a006 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:08 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a578b830-a891-43ae-9446-12784658a006 Jul 10 05:01:08 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:08 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5de28161-4578-4dc3-bc0f-cac7330ade7a tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.71c9d930-f686-407d-b56f-01a9fa3a112e" returned: 0 in 0.820s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5de28161-4578-4dc3-bc0f-cac7330ade7a tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:08 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.info Jul 10 05:01:08 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:09 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9c8e1fb4-8329-46d7-ae70-6023cc6bef0f tempest-CinderUnicodeTest-1487229715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 1.120s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:09 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-9c8e1fb4-8329-46d7-ae70-6023cc6bef0f tempest-CinderUnicodeTest-1487229715 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:01:09 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-9c8e1fb4-8329-46d7-ae70-6023cc6bef0f tempest-CinderUnicodeTest-1487229715 None] Deleted volume successfully. Jul 10 05:01:09 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9c8e1fb4-8329-46d7-ae70-6023cc6bef0f tempest-CinderUnicodeTest-1487229715 None] Lock "cinder-aabfd81f-589f-437f-9c57-6bad2e20b6be-delete_volume" released by "delete_volume" :: held 3.398s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:09 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-10995d38-9bf6-4315-9209-2ffedf6a7041 tempest-CinderUnicodeTest-1487229715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a578b830-a891-43ae-9446-12784658a006" returned: 0 in 1.367s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-10995d38-9bf6-4315-9209-2ffedf6a7041 tempest-CinderUnicodeTest-1487229715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a578b830-a891-43ae-9446-12784658a006 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:09 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5de28161-4578-4dc3-bc0f-cac7330ade7a tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.info" returned: 0 in 0.918s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:09 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-5de28161-4578-4dc3-bc0f-cac7330ade7a tempest-ProjectReaderTests-849381127 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.info is being set with open permissions: ugo+rw Jul 10 05:01:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5de28161-4578-4dc3-bc0f-cac7330ade7a tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:09 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a578b830-a891-43ae-9446-12784658a006 Jul 10 05:01:09 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:09 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.info Jul 10 05:01:09 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:10 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-10995d38-9bf6-4315-9209-2ffedf6a7041 tempest-CinderUnicodeTest-1487229715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-a578b830-a891-43ae-9446-12784658a006" returned: 0 in 0.830s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-10995d38-9bf6-4315-9209-2ffedf6a7041 tempest-CinderUnicodeTest-1487229715 None] Lock "cinder-quobyte-a578b830-a891-43ae-9446-12784658a006" released by "delete_volume" :: held 2.270s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:10 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-5de28161-4578-4dc3-bc0f-cac7330ade7a tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.info" returned: 0 in 0.917s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-5de28161-4578-4dc3-bc0f-cac7330ade7a tempest-ProjectReaderTests-849381127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:10 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-10995d38-9bf6-4315-9209-2ffedf6a7041 tempest-CinderUnicodeTest-1487229715 None] Created reservations ['5528d83f-4bf2-4eb1-b737-80aacf79f65f', '378c3b76-c374-4d78-b158-9ac889c6fd94', '38ce8cf4-1963-4b5e-a08a-932204b4bf11', 'a332d8ff-7c00-4780-8b34-ea0e71d1411d'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:01:10 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-5de28161-4578-4dc3-bc0f-cac7330ade7a tempest-ProjectReaderTests-849381127 None] Create snapshot completed successfully Jul 10 05:01:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-10995d38-9bf6-4315-9209-2ffedf6a7041 tempest-CinderUnicodeTest-1487229715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-10995d38-9bf6-4315-9209-2ffedf6a7041 tempest-CinderUnicodeTest-1487229715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-10995d38-9bf6-4315-9209-2ffedf6a7041 tempest-CinderUnicodeTest-1487229715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:01:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-10995d38-9bf6-4315-9209-2ffedf6a7041 tempest-CinderUnicodeTest-1487229715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:01:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-10995d38-9bf6-4315-9209-2ffedf6a7041 tempest-CinderUnicodeTest-1487229715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-10995d38-9bf6-4315-9209-2ffedf6a7041 tempest-CinderUnicodeTest-1487229715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:10 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:01:10 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3108043d-7c24-4803-a596-c2707a8e7f66 tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-71c9d930-f686-407d-b56f-01a9fa3a112e-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3108043d-7c24-4803-a596-c2707a8e7f66 tempest-ProjectReaderTests-849381127 None] Lock "cinder-71c9d930-f686-407d-b56f-01a9fa3a112e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3108043d-7c24-4803-a596-c2707a8e7f66 tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-quobyte-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3108043d-7c24-4803-a596-c2707a8e7f66 tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3108043d-7c24-4803-a596-c2707a8e7f66 tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-quobyte-71c9d930-f686-407d-b56f-01a9fa3a112e" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:11 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3108043d-7c24-4803-a596-c2707a8e7f66 tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-71c9d930-f686-407d-b56f-01a9fa3a112e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:11 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-3108043d-7c24-4803-a596-c2707a8e7f66 tempest-ProjectReaderTests-849381127 None] Deleting offline snapshot 71c9d930-f686-407d-b56f-01a9fa3a112e of volume e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:01:11 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-3108043d-7c24-4803-a596-c2707a8e7f66 tempest-ProjectReaderTests-849381127 None] snapshot_file for this snap is: volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.71c9d930-f686-407d-b56f-01a9fa3a112e {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:01:11 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceda49bb-4769-432b-8eee-b06b58d60a9c]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3108043d-7c24-4803-a596-c2707a8e7f66 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.71c9d930-f686-407d-b56f-01a9fa3a112e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:11 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.71c9d930-f686-407d-b56f-01a9fa3a112e Jul 10 05:01:11 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:11 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-10995d38-9bf6-4315-9209-2ffedf6a7041 tempest-CinderUnicodeTest-1487229715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.810s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:11 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-10995d38-9bf6-4315-9209-2ffedf6a7041 tempest-CinderUnicodeTest-1487229715 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:01:11 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-10995d38-9bf6-4315-9209-2ffedf6a7041 tempest-CinderUnicodeTest-1487229715 None] Deleted volume successfully. Jul 10 05:01:11 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-10995d38-9bf6-4315-9209-2ffedf6a7041 tempest-CinderUnicodeTest-1487229715 None] Lock "cinder-a578b830-a891-43ae-9446-12784658a006-delete_volume" released by "delete_volume" :: held 3.481s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:12 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3108043d-7c24-4803-a596-c2707a8e7f66 tempest-ProjectReaderTests-849381127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.71c9d930-f686-407d-b56f-01a9fa3a112e" returned: 0 in 0.949s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:12 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-3108043d-7c24-4803-a596-c2707a8e7f66 tempest-ProjectReaderTests-849381127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:01:12 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[493a5427-6e90-475c-860d-6983be2e2ff8]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3108043d-7c24-4803-a596-c2707a8e7f66 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:12 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5 Jul 10 05:01:12 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:12 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3108043d-7c24-4803-a596-c2707a8e7f66 tempest-ProjectReaderTests-849381127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5" returned: 0 in 0.891s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3108043d-7c24-4803-a596-c2707a8e7f66 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.71c9d930-f686-407d-b56f-01a9fa3a112e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:12 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.71c9d930-f686-407d-b56f-01a9fa3a112e Jul 10 05:01:12 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:14 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3108043d-7c24-4803-a596-c2707a8e7f66 tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.71c9d930-f686-407d-b56f-01a9fa3a112e" returned: 0 in 1.063s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3108043d-7c24-4803-a596-c2707a8e7f66 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.71c9d930-f686-407d-b56f-01a9fa3a112e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:14 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.71c9d930-f686-407d-b56f-01a9fa3a112e Jul 10 05:01:14 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:14 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3108043d-7c24-4803-a596-c2707a8e7f66 tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5.71c9d930-f686-407d-b56f-01a9fa3a112e" returned: 0 in 0.749s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3108043d-7c24-4803-a596-c2707a8e7f66 tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-71c9d930-f686-407d-b56f-01a9fa3a112e" released by "_delete_snapshot" :: held 3.793s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3108043d-7c24-4803-a596-c2707a8e7f66 tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5" released by "delete_snapshot" :: held 3.831s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:14 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-3108043d-7c24-4803-a596-c2707a8e7f66 tempest-ProjectReaderTests-849381127 None] Created reservations ['1c4e6b32-d1de-444e-80f9-be73c4c5c17b', 'f11eeff5-5c2b-431a-8517-ba4588891bdf', '59cdfb95-9103-4665-a410-343896b2f1a4', 'f94a36f6-88b2-4af5-a539-9db0073f2c32'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:01:14 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-3108043d-7c24-4803-a596-c2707a8e7f66 tempest-ProjectReaderTests-849381127 None] Delete snapshot completed successfully. Jul 10 05:01:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3108043d-7c24-4803-a596-c2707a8e7f66 tempest-ProjectReaderTests-849381127 None] Lock "cinder-71c9d930-f686-407d-b56f-01a9fa3a112e-delete_snapshot" released by "delete_snapshot" :: held 4.008s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Flow 'volume_create_manager' (03b96909-e396-4c19-bd80-a9b1ed55b0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c3b067-69c8-4cdf-ab45-9e0f9752fd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c3b067-69c8-4cdf-ab45-9e0f9752fd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835a8db0-6955-412f-822b-82c8a63c1ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917716939da84510a860f35e1d719af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:01:15Z,use_quota=True,user_id='2e80341baad24565b8898e7d2e4c3685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58364fc2-60d0-4b17-9744-c8007f93faa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58364fc2-60d0-4b17-9744-c8007f93faa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395179aa-63e2-4099-8b11-308e6700e890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG cinder.image.glance [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Creating Keystone auth plugin from conf {{(pid=87359) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-09beed78-dd50-4a7c-9ccc-64c61339f67c tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-09beed78-dd50-4a7c-9ccc-64c61339f67c tempest-ProjectReaderTests-849381127 None] Lock "cinder-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-09beed78-dd50-4a7c-9ccc-64c61339f67c tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-quobyte-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-09beed78-dd50-4a7c-9ccc-64c61339f67c tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5" acquired by "delete_volume" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4fa322-a5f0-4caf-ac8f-e860c21779f8]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-09beed78-dd50-4a7c-9ccc-64c61339f67c tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:15 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5 Jul 10 05:01:15 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395179aa-63e2-4099-8b11-308e6700e890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '835a8db0-6955-412f-822b-82c8a63c1ca8', 'volume_name': 'volume-835a8db0-6955-412f-822b-82c8a63c1ca8', 'volume_size': 1, 'image_id': '7fadf0e9-3eb3-46f5-bc98-22af0432967d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7fadf0e9-3eb3-46f5-bc98-22af0432967d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '910caca21f0fd55466b8d30dfa3dbeed', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '917716939da84510a860f35e1d719af1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1dbb7081638e19701030251e9c9aa43edebf8ee421d343695828262375e0a46f3fc71c5f8e72ceb8711f36a27118eea78cdf92565ee14cf84aa52a88a397e863', 'id': '7fadf0e9-3eb3-46f5-bc98-22af0432967d', 'created_at': datetime.datetime(2026, 7, 10, 3, 1, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 3, 1, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7fadf0e9-3eb3-46f5-bc98-22af0432967d/file', 'properties': {}}, 'image_service': }' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f6dd143-a7b8-4fe7-a85e-44525cf965ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f6dd143-a7b8-4fe7-a85e-44525cf965ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b58e7f6c-3801-46a0-84a6-c09d253810a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:15 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Volume 835a8db0-6955-412f-822b-82c8a63c1ca8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-835a8db0-6955-412f-822b-82c8a63c1ca8', 'volume_size': 1, 'image_id': '7fadf0e9-3eb3-46f5-bc98-22af0432967d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7fadf0e9-3eb3-46f5-bc98-22af0432967d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '910caca21f0fd55466b8d30dfa3dbeed', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '917716939da84510a860f35e1d719af1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1dbb7081638e19701030251e9c9aa43edebf8ee421d343695828262375e0a46f3fc71c5f8e72ceb8711f36a27118eea78cdf92565ee14cf84aa52a88a397e863', 'id': '7fadf0e9-3eb3-46f5-bc98-22af0432967d', 'created_at': datetime.datetime(2026, 7, 10, 3, 1, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 3, 1, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7fadf0e9-3eb3-46f5-bc98-22af0432967d/file', 'properties': {}}, 'image_service': } Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Trying to clone 835a8db0-6955-412f-822b-82c8a63c1ca8 from image 7fadf0e9-3eb3-46f5-bc98-22af0432967d at location (None, [{'url': 'file:///opt/stack/data/glance/images/7fadf0e9-3eb3-46f5-bc98-22af0432967d', 'metadata': {}}]). {{(pid=87359) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:15 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:01:15 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:16 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Jul 10 05:01:16 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Image download 0.00 MB at 0.00 MB/s Jul 10 05:01:16 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e9daa1-6a29-4e90-ad25-3065463a2660]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:16 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD Jul 10 05:01:16 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:16 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-09beed78-dd50-4a7c-9ccc-64c61339f67c tempest-ProjectReaderTests-849381127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5" returned: 0 in 0.860s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-09beed78-dd50-4a7c-9ccc-64c61339f67c tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:16 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5 Jul 10 05:01:16 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:16 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.717s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:01:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:01:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 05:01:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 05:01:16 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD" returned: 0 in 0.775s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:16 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-09beed78-dd50-4a7c-9ccc-64c61339f67c tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5" returned: 0 in 0.693s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:16 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-09beed78-dd50-4a7c-9ccc-64c61339f67c tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5" released by "delete_volume" :: held 1.618s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:16 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD Jul 10 05:01:16 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:16 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-09beed78-dd50-4a7c-9ccc-64c61339f67c tempest-ProjectReaderTests-849381127 None] Created reservations ['9288461a-0e61-4f70-9c51-66488e46807f', '103a735f-2699-498a-b93f-67c6bdcafecf', '66dbf83d-c58e-479e-86d7-8864f6a519aa', 'de4e916a-34fc-4c11-ba2d-6633b2540672'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:01:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-09beed78-dd50-4a7c-9ccc-64c61339f67c tempest-ProjectReaderTests-849381127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-09beed78-dd50-4a7c-9ccc-64c61339f67c tempest-ProjectReaderTests-849381127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-09beed78-dd50-4a7c-9ccc-64c61339f67c tempest-ProjectReaderTests-849381127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:01:17 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-09beed78-dd50-4a7c-9ccc-64c61339f67c tempest-ProjectReaderTests-849381127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:01:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-09beed78-dd50-4a7c-9ccc-64c61339f67c tempest-ProjectReaderTests-849381127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-09beed78-dd50-4a7c-9ccc-64c61339f67c tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:17 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:01:17 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:17 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD" returned: 1 in 0.751s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 05:01:17 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Temporary image 7fadf0e9-3eb3-46f5-bc98-22af0432967d is fetched for user 2e80341baad24565b8898e7d2e4c3685. {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Jul 10 05:01:17 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[634b0375-0953-4e48-9f00-911018cd0649]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:17 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-09beed78-dd50-4a7c-9ccc-64c61339f67c tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.738s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:17 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-09beed78-dd50-4a7c-9ccc-64c61339f67c tempest-ProjectReaderTests-849381127 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:01:17 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-09beed78-dd50-4a7c-9ccc-64c61339f67c tempest-ProjectReaderTests-849381127 None] Deleted volume successfully. Jul 10 05:01:17 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD Jul 10 05:01:17 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:17 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-09beed78-dd50-4a7c-9ccc-64c61339f67c tempest-ProjectReaderTests-849381127 None] Lock "cinder-e0653eb3-5522-4b8c-9afc-d8dfd8b6bac5-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Flow 'volume_create_manager' (55e73169-f0b6-48f7-b500-29bc158fc878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0e65f4-33c3-45f2-ac0f-e74ec4ae81f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0e65f4-33c3-45f2-ac0f-e74ec4ae81f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-587753719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ed409c-e486-4f19-b67b-d9ab88b7a2ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3197eac694784dd6bff647edd9e49582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:01:18Z,use_quota=True,user_id='4abcde3dd0b34fba8f492d431f7a7696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31541ccc-f28a-4f54-85c2-62c23dd5790d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31541ccc-f28a-4f54-85c2-62c23dd5790d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c10c53df-20b7-48c3-aede-e88250265ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c10c53df-20b7-48c3-aede-e88250265ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4ed409c-e486-4f19-b67b-d9ab88b7a2ac', 'volume_name': 'volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b223ee4-17ff-4d5d-938f-010da1388524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b223ee4-17ff-4d5d-938f-010da1388524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aaa7727-1bb9-4764-afd9-1b2f6c9bf9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:18 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Volume b4ed409c-e486-4f19-b67b-d9ab88b7a2ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac', 'volume_size': 1} Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-587753719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ed409c-e486-4f19-b67b-d9ab88b7a2ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3197eac694784dd6bff647edd9e49582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:01:18Z,use_quota=True,user_id='4abcde3dd0b34fba8f492d431f7a7696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Creating volume b4ed409c-e486-4f19-b67b-d9ab88b7a2ac {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:01:18 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:18 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac 1073741824 Jul 10 05:01:18 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:18 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD" returned: 0 in 0.788s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:18 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD Jul 10 05:01:18 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:19 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac 1073741824" returned: 0 in 0.988s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:19 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac Jul 10 05:01:19 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:19 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD" returned: 1 in 0.881s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 05:01:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:19 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac" returned: 0 in 0.683s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:01:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.527s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835a8db0-6955-412f-822b-82c8a63c1ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917716939da84510a860f35e1d719af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:01:15Z,use_quota=True,user_id='2e80341baad24565b8898e7d2e4c3685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:01:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Creating volume 835a8db0-6955-412f-822b-82c8a63c1ca8 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:01:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:01:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:01:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:01:19 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:01:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:19 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8 1073741824 Jul 10 05:01:19 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aaa7727-1bb9-4764-afd9-1b2f6c9bf9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:19 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a5febe-0f77-4491-952e-c6aa438acbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:20 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Volume volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac (b4ed409c-e486-4f19-b67b-d9ab88b7a2ac): created successfully Jul 10 05:01:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a5febe-0f77-4491-952e-c6aa438acbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:20 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Flow 'volume_create_manager' (55e73169-f0b6-48f7-b500-29bc158fc878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:01:20 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a19904e3-ed58-485a-a0e3-f171fce84258 tempest-ProjectReaderTests-849381127 None] Created volume successfully. Jul 10 05:01:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0a563260-a006-40fb-be6c-0169fce10695 tempest-ProjectReaderTests-849381127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:20 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8 1073741824" returned: 0 in 0.930s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:20 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8 Jul 10 05:01:20 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:21 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:01:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Flow 'volume_create_manager' (afb0a18b-0c47-4ce0-bdb1-4bc095a81919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:01:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e4ff493-394b-4a96-8d08-ce1fd1525326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e4ff493-394b-4a96-8d08-ce1fd1525326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1246946656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18c30f75-0ad5-4dca-af9e-6548f07a2c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4b418f932c4d1f8f37edd3cc0b7dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:01:21Z,use_quota=True,user_id='124e0cf464a84f5ab1b9058b1a0fffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4be77a9-2227-4ccc-9b19-136913396301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4be77a9-2227-4ccc-9b19-136913396301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c798ce83-cf35-445c-8513-6d225f491543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c798ce83-cf35-445c-8513-6d225f491543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18c30f75-0ad5-4dca-af9e-6548f07a2c27', 'volume_name': 'volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8308baa6-7139-4d95-b22f-5ff919a9c422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8308baa6-7139-4d95-b22f-5ff919a9c422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a8baf2-7021-42e9-a9ca-c097c1b42da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:21 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Volume 18c30f75-0ad5-4dca-af9e-6548f07a2c27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27', 'volume_size': 1} Jul 10 05:01:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:21 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8" returned: 0 in 0.673s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:01:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0a563260-a006-40fb-be6c-0169fce10695 tempest-ProjectReaderTests-849381127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.200s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-0a563260-a006-40fb-be6c-0169fce10695 tempest-ProjectReaderTests-849381127 None] Creating offline snapshot a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e of volume b4ed409c-e486-4f19-b67b-d9ab88b7a2ac {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:01:21 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Attempting download of 7fadf0e9-3eb3-46f5-bc98-22af0432967d ((None, [{'url': 'file:///opt/stack/data/glance/images/7fadf0e9-3eb3-46f5-bc98-22af0432967d', 'metadata': {}}])) to volume 835a8db0-6955-412f-822b-82c8a63c1ca8. {{(pid=87359) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 05:01:21 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[591d681e-f6c0-4cb6-b999-7b0aff9a05b4]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0a563260-a006-40fb-be6c-0169fce10695 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:21 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[d964cb12-f9ac-4b30-a389-68f41af5c296]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7fadf0e9-3eb3-46f5-bc98-22af0432967d_gv4kynjk {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:21 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac Jul 10 05:01:21 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:21 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7fadf0e9-3eb3-46f5-bc98-22af0432967d_gv4kynjk Jul 10 05:01:21 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:22 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7fadf0e9-3eb3-46f5-bc98-22af0432967d_gv4kynjk" returned: 0 in 0.717s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7fadf0e9-3eb3-46f5-bc98-22af0432967d_gv4kynjk {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:22 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0a563260-a006-40fb-be6c-0169fce10695 tempest-ProjectReaderTests-849381127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac" returned: 0 in 0.780s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0a563260-a006-40fb-be6c-0169fce10695 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:22 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e 1G Jul 10 05:01:22 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:22 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7fadf0e9-3eb3-46f5-bc98-22af0432967d_gv4kynjk Jul 10 05:01:22 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:23 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7fadf0e9-3eb3-46f5-bc98-22af0432967d_gv4kynjk" returned: 1 in 0.723s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7fadf0e9-3eb3-46f5-bc98-22af0432967d_gv4kynjk' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 05:01:23 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c341e6-9259-427d-bfa6-c0d0a5500beb]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:23 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0a563260-a006-40fb-be6c-0169fce10695 tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e 1G" returned: 0 in 0.792s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0a563260-a006-40fb-be6c-0169fce10695 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:23 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e Jul 10 05:01:23 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:23 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD Jul 10 05:01:23 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:23 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD" returned: 0 in 0.736s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:23 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0a563260-a006-40fb-be6c-0169fce10695 tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e" returned: 0 in 0.683s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:23 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-0a563260-a006-40fb-be6c-0169fce10695 tempest-ProjectReaderTests-849381127 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e is being set with open permissions: ugo+rw Jul 10 05:01:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0a563260-a006-40fb-be6c-0169fce10695 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:23 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e Jul 10 05:01:23 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:23 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD Jul 10 05:01:23 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:24 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0a563260-a006-40fb-be6c-0169fce10695 tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e" returned: 0 in 0.660s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:24 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0a563260-a006-40fb-be6c-0169fce10695 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD" returned: 1 in 0.729s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 05:01:24 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] 7fadf0e9-3eb3-46f5-bc98-22af0432967d was raw, converting to raw {{(pid=87359) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Jul 10 05:01:24 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.info Jul 10 05:01:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:24 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:24 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8 Jul 10 05:01:24 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:25 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0a563260-a006-40fb-be6c-0169fce10695 tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.info" returned: 0 in 0.635s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:25 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-0a563260-a006-40fb-be6c-0169fce10695 tempest-ProjectReaderTests-849381127 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.info is being set with open permissions: ugo+rw Jul 10 05:01:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0a563260-a006-40fb-be6c-0169fce10695 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:25 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.info Jul 10 05:01:25 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:25 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8" returned: 0 in 0.751s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:25 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7fadf0e9-3eb3-46f5-bc98-22af0432967d_z717jm6hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8 {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 05:01:25 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 05:01:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:25 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8 1G Jul 10 05:01:25 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:25 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0a563260-a006-40fb-be6c-0169fce10695 tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.info" returned: 0 in 0.646s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0a563260-a006-40fb-be6c-0169fce10695 tempest-ProjectReaderTests-849381127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.293s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.423s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1246946656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18c30f75-0ad5-4dca-af9e-6548f07a2c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4b418f932c4d1f8f37edd3cc0b7dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:01:21Z,use_quota=True,user_id='124e0cf464a84f5ab1b9058b1a0fffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:01:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Creating volume 18c30f75-0ad5-4dca-af9e-6548f07a2c27 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:01:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:01:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:01:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:25 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:01:25 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:01:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:25 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27 1073741824 Jul 10 05:01:25 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:25 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-0a563260-a006-40fb-be6c-0169fce10695 tempest-ProjectReaderTests-849381127 None] Create snapshot completed successfully Jul 10 05:01:26 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8 1G" returned: 0 in 0.677s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:26 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e9d5b1-1b50-456c-bc91-88c37c267fc4]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:26 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8 Jul 10 05:01:26 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:26 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c843d83b-41e6-450f-9aac-40a6487f2d5a tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:26 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c843d83b-41e6-450f-9aac-40a6487f2d5a tempest-ProjectReaderTests-849381127 None] Lock "cinder-a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:26 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c843d83b-41e6-450f-9aac-40a6487f2d5a tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-quobyte-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:26 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c843d83b-41e6-450f-9aac-40a6487f2d5a tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:26 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c843d83b-41e6-450f-9aac-40a6487f2d5a tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-quobyte-a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:26 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c843d83b-41e6-450f-9aac-40a6487f2d5a tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-c843d83b-41e6-450f-9aac-40a6487f2d5a tempest-ProjectReaderTests-849381127 None] Deleting offline snapshot a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e of volume b4ed409c-e486-4f19-b67b-d9ab88b7a2ac {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:01:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-c843d83b-41e6-450f-9aac-40a6487f2d5a tempest-ProjectReaderTests-849381127 None] snapshot_file for this snap is: volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:01:26 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e5c163-ab9d-41f5-a946-08301fb00935]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c843d83b-41e6-450f-9aac-40a6487f2d5a tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:26 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27 1073741824" returned: 0 in 0.929s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:26 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8" returned: 0 in 0.799s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:26 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27 Jul 10 05:01:26 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:26 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e Jul 10 05:01:26 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:26 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8 Jul 10 05:01:26 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:27 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27" returned: 0 in 0.665s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:27 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a8baf2-7021-42e9-a9ca-c097c1b42da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdb4775-97c6-4ca2-aa70-36e9afb8d542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c843d83b-41e6-450f-9aac-40a6487f2d5a tempest-ProjectReaderTests-849381127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e" returned: 0 in 0.768s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-c843d83b-41e6-450f-9aac-40a6487f2d5a tempest-ProjectReaderTests-849381127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:01:27 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Volume volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27 (18c30f75-0ad5-4dca-af9e-6548f07a2c27): created successfully Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdb4775-97c6-4ca2-aa70-36e9afb8d542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Flow 'volume_create_manager' (afb0a18b-0c47-4ce0-bdb1-4bc095a81919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da7756c-ae19-4612-87f7-bbd9b0f94efb]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c843d83b-41e6-450f-9aac-40a6487f2d5a tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:27 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-8bb40b05-1fbf-440e-8753-6a64b4161ad6 tempest-ProjectMemberTests-1536548769 None] Created volume successfully. Jul 10 05:01:27 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8" returned: 1 in 0.795s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Downloaded image 7fadf0e9-3eb3-46f5-bc98-22af0432967d ((None, [{'url': 'file:///opt/stack/data/glance/images/7fadf0e9-3eb3-46f5-bc98-22af0432967d', 'metadata': {}}])) to volume 835a8db0-6955-412f-822b-82c8a63c1ca8 successfully. {{(pid=87359) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Temporary image 7fadf0e9-3eb3-46f5-bc98-22af0432967d for user 2e80341baad24565b8898e7d2e4c3685 is deleted. {{(pid=87359) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG cinder.volume.volume_utils [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Marking volume 835a8db0-6955-412f-822b-82c8a63c1ca8 as bootable. {{(pid=87359) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Copying metadata from image 7fadf0e9-3eb3-46f5-bc98-22af0432967d to 835a8db0-6955-412f-822b-82c8a63c1ca8. {{(pid=87359) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Creating volume glance metadata for volume 835a8db0-6955-412f-822b-82c8a63c1ca8 backed by image 7fadf0e9-3eb3-46f5-bc98-22af0432967d with: {'image_id': '7fadf0e9-3eb3-46f5-bc98-22af0432967d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '910caca21f0fd55466b8d30dfa3dbeed', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87359) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 05:01:27 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac Jul 10 05:01:27 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b58e7f6c-3801-46a0-84a6-c09d253810a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-835a8db0-6955-412f-822b-82c8a63c1ca8', 'volume_size': 1, 'image_id': '7fadf0e9-3eb3-46f5-bc98-22af0432967d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7fadf0e9-3eb3-46f5-bc98-22af0432967d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '910caca21f0fd55466b8d30dfa3dbeed', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '917716939da84510a860f35e1d719af1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1dbb7081638e19701030251e9c9aa43edebf8ee421d343695828262375e0a46f3fc71c5f8e72ceb8711f36a27118eea78cdf92565ee14cf84aa52a88a397e863', 'id': '7fadf0e9-3eb3-46f5-bc98-22af0432967d', 'created_at': datetime.datetime(2026, 7, 10, 3, 1, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 3, 1, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7fadf0e9-3eb3-46f5-bc98-22af0432967d/file', 'properties': {}}, 'image_service': }' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85dc218a-04d2-4a13-b135-86ca934dd1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:27 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Volume volume-835a8db0-6955-412f-822b-82c8a63c1ca8 (835a8db0-6955-412f-822b-82c8a63c1ca8): created successfully Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85dc218a-04d2-4a13-b135-86ca934dd1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Flow 'volume_create_manager' (03b96909-e396-4c19-bd80-a9b1ed55b0c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:01:27 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ec06f4ed-95e8-4113-8454-5fcbd69e4c45 tempest-VolumeImageDependencyTests-282866623 None] Created volume successfully. Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] Acquiring lock "cinder-835a8db0-6955-412f-822b-82c8a63c1ca8-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] Lock "cinder-835a8db0-6955-412f-822b-82c8a63c1ca8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] Acquiring lock "cinder-quobyte-835a8db0-6955-412f-822b-82c8a63c1ca8" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:27 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] Lock "cinder-quobyte-835a8db0-6955-412f-822b-82c8a63c1ca8" acquired by "delete_volume" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:28 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[76438c01-f00e-4fdc-9ebd-97c0919602a0]: (4, 'raw') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:28 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8 Jul 10 05:01:28 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:28 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c843d83b-41e6-450f-9aac-40a6487f2d5a tempest-ProjectReaderTests-849381127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac" returned: 0 in 0.806s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c843d83b-41e6-450f-9aac-40a6487f2d5a tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:28 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e Jul 10 05:01:28 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:28 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8" returned: 0 in 0.827s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:28 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8 Jul 10 05:01:29 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-89ffc0be-5c25-4f8e-b0e8-66fe8afdb590 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-89ffc0be-5c25-4f8e-b0e8-66fe8afdb590 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-89ffc0be-5c25-4f8e-b0e8-66fe8afdb590 tempest-ProjectMemberTests-1536548769 None] Creating offline snapshot 9f923495-3bc6-418a-871f-10d615b946a6 of volume 18c30f75-0ad5-4dca-af9e-6548f07a2c27 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:01:29 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e6a319-6f1a-4d94-b60a-1d8959e94781]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89ffc0be-5c25-4f8e-b0e8-66fe8afdb590 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:29 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c843d83b-41e6-450f-9aac-40a6487f2d5a tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e" returned: 0 in 0.826s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c843d83b-41e6-450f-9aac-40a6487f2d5a tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:29 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27 Jul 10 05:01:29 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:29 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e Jul 10 05:01:29 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:29 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8" returned: 1 in 0.827s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8' failed. Not Retrying. {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 05:01:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:29 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8 Jul 10 05:01:29 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:29 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c843d83b-41e6-450f-9aac-40a6487f2d5a tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac.a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e" returned: 0 in 0.664s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c843d83b-41e6-450f-9aac-40a6487f2d5a tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e" released by "_delete_snapshot" :: held 3.197s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:29 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:29 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c843d83b-41e6-450f-9aac-40a6487f2d5a tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac" released by "delete_snapshot" :: held 3.227s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89ffc0be-5c25-4f8e-b0e8-66fe8afdb590 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27" returned: 0 in 0.824s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89ffc0be-5c25-4f8e-b0e8-66fe8afdb590 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.9f923495-3bc6-418a-871f-10d615b946a6 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:29 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.9f923495-3bc6-418a-871f-10d615b946a6 1G Jul 10 05:01:29 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:30 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-c843d83b-41e6-450f-9aac-40a6487f2d5a tempest-ProjectReaderTests-849381127 None] Created reservations ['751ec89b-be31-4533-9c15-5b795c7dba25', 'ea95c3eb-007c-4d46-829f-16468f568c34', '57e7360f-2ee7-44d5-8d32-15b1f86916ed', 'c0296ba3-3a69-4bb7-8514-e20249a5075e'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:01:30 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c843d83b-41e6-450f-9aac-40a6487f2d5a tempest-ProjectReaderTests-849381127 None] Delete snapshot completed successfully. Jul 10 05:01:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-c843d83b-41e6-450f-9aac-40a6487f2d5a tempest-ProjectReaderTests-849381127 None] Lock "cinder-a1c82e1e-632e-4ca8-a6d3-3fa43796ca7e-delete_snapshot" released by "delete_snapshot" :: held 3.425s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:30 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-835a8db0-6955-412f-822b-82c8a63c1ca8" returned: 0 in 0.670s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] Lock "cinder-quobyte-835a8db0-6955-412f-822b-82c8a63c1ca8" released by "delete_volume" :: held 2.385s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:30 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] Created reservations ['8e8cf831-970b-4a18-9bb0-7b92938b6b74', 'bd27970f-2f7a-4c77-b23e-42c0e9315fdb', '30cc82a6-6e9f-4080-9733-7a3e1c068df4', '876bf207-18fb-4a43-9dbc-d254e404e674'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:01:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:30 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:01:30 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:01:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:30 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:01:30 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:30 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89ffc0be-5c25-4f8e-b0e8-66fe8afdb590 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.9f923495-3bc6-418a-871f-10d615b946a6 1G" returned: 0 in 0.877s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89ffc0be-5c25-4f8e-b0e8-66fe8afdb590 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.9f923495-3bc6-418a-871f-10d615b946a6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:30 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.9f923495-3bc6-418a-871f-10d615b946a6 Jul 10 05:01:30 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ddeba6fd-cf5d-42f3-80a3-8ec87efab19d tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ddeba6fd-cf5d-42f3-80a3-8ec87efab19d tempest-ProjectReaderTests-849381127 None] Lock "cinder-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:30 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ddeba6fd-cf5d-42f3-80a3-8ec87efab19d tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-quobyte-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:31 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ddeba6fd-cf5d-42f3-80a3-8ec87efab19d tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:31 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b14c7ce-0f91-475c-aaf0-db703c4653c8]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ddeba6fd-cf5d-42f3-80a3-8ec87efab19d tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:31 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac Jul 10 05:01:31 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:31 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.663s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:31 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:01:31 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] Deleted volume successfully. Jul 10 05:01:31 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-99c148ae-3987-45d2-82a5-4800dfd943f7 tempest-VolumeImageDependencyTests-282866623 None] Lock "cinder-835a8db0-6955-412f-822b-82c8a63c1ca8-delete_volume" released by "delete_volume" :: held 3.294s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:31 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89ffc0be-5c25-4f8e-b0e8-66fe8afdb590 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.9f923495-3bc6-418a-871f-10d615b946a6" returned: 0 in 0.758s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:31 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-89ffc0be-5c25-4f8e-b0e8-66fe8afdb590 tempest-ProjectMemberTests-1536548769 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.9f923495-3bc6-418a-871f-10d615b946a6 is being set with open permissions: ugo+rw Jul 10 05:01:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89ffc0be-5c25-4f8e-b0e8-66fe8afdb590 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.9f923495-3bc6-418a-871f-10d615b946a6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:31 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.9f923495-3bc6-418a-871f-10d615b946a6 Jul 10 05:01:31 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:31 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ddeba6fd-cf5d-42f3-80a3-8ec87efab19d tempest-ProjectReaderTests-849381127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac" returned: 0 in 0.822s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ddeba6fd-cf5d-42f3-80a3-8ec87efab19d tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:31 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac Jul 10 05:01:31 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:32 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89ffc0be-5c25-4f8e-b0e8-66fe8afdb590 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.9f923495-3bc6-418a-871f-10d615b946a6" returned: 0 in 0.809s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89ffc0be-5c25-4f8e-b0e8-66fe8afdb590 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:32 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.info Jul 10 05:01:32 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:32 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ddeba6fd-cf5d-42f3-80a3-8ec87efab19d tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac" returned: 0 in 0.717s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ddeba6fd-cf5d-42f3-80a3-8ec87efab19d tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac" released by "delete_volume" :: held 1.616s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:32 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-ddeba6fd-cf5d-42f3-80a3-8ec87efab19d tempest-ProjectReaderTests-849381127 None] Created reservations ['33f3e0a1-cfb9-4bad-95d0-15f556e7419f', 'cdc3a31e-cfde-4b2a-9794-aa1f5018d86a', '8ad25489-c0e0-4dd5-aee6-0cff89202ff9', '24d857d6-f9c8-473d-b34a-28ba67518a70'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:01:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ddeba6fd-cf5d-42f3-80a3-8ec87efab19d tempest-ProjectReaderTests-849381127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ddeba6fd-cf5d-42f3-80a3-8ec87efab19d tempest-ProjectReaderTests-849381127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ddeba6fd-cf5d-42f3-80a3-8ec87efab19d tempest-ProjectReaderTests-849381127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:01:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ddeba6fd-cf5d-42f3-80a3-8ec87efab19d tempest-ProjectReaderTests-849381127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:01:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ddeba6fd-cf5d-42f3-80a3-8ec87efab19d tempest-ProjectReaderTests-849381127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ddeba6fd-cf5d-42f3-80a3-8ec87efab19d tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:32 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:01:32 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:33 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89ffc0be-5c25-4f8e-b0e8-66fe8afdb590 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.info" returned: 0 in 0.723s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:33 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-89ffc0be-5c25-4f8e-b0e8-66fe8afdb590 tempest-ProjectMemberTests-1536548769 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.info is being set with open permissions: ugo+rw Jul 10 05:01:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89ffc0be-5c25-4f8e-b0e8-66fe8afdb590 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:33 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.info Jul 10 05:01:33 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:33 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ddeba6fd-cf5d-42f3-80a3-8ec87efab19d tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.829s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:33 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-ddeba6fd-cf5d-42f3-80a3-8ec87efab19d tempest-ProjectReaderTests-849381127 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:01:33 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ddeba6fd-cf5d-42f3-80a3-8ec87efab19d tempest-ProjectReaderTests-849381127 None] Deleted volume successfully. Jul 10 05:01:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-ddeba6fd-cf5d-42f3-80a3-8ec87efab19d tempest-ProjectReaderTests-849381127 None] Lock "cinder-b4ed409c-e486-4f19-b67b-d9ab88b7a2ac-delete_volume" released by "delete_volume" :: held 2.688s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:33 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:01:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Flow 'volume_create_manager' (f687dd9b-0aef-4e34-9b79-442f9f60e5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:01:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db3f06d-214d-4d53-b615-d3733e383f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db3f06d-214d-4d53-b615-d3733e383f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1798341505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d9753b5-ea1b-432c-ac74-def9260a24c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3197eac694784dd6bff647edd9e49582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:01:34Z,use_quota=True,user_id='4abcde3dd0b34fba8f492d431f7a7696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e6946a-da65-4612-9f16-613636a5a5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e6946a-da65-4612-9f16-613636a5a5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3002ee8-5a39-42c1-b341-479a16022018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3002ee8-5a39-42c1-b341-479a16022018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d9753b5-ea1b-432c-ac74-def9260a24c6', 'volume_name': 'volume-8d9753b5-ea1b-432c-ac74-def9260a24c6', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b90d7c5-569c-464c-9012-5fc3e9c5a7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b90d7c5-569c-464c-9012-5fc3e9c5a7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:33 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d583ca81-4efb-4f69-b33a-158a7028f8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:33 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Volume 8d9753b5-ea1b-432c-ac74-def9260a24c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d9753b5-ea1b-432c-ac74-def9260a24c6', 'volume_size': 1} Jul 10 05:01:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:34 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-89ffc0be-5c25-4f8e-b0e8-66fe8afdb590 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.info" returned: 0 in 0.816s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-89ffc0be-5c25-4f8e-b0e8-66fe8afdb590 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.921s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.201s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1798341505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d9753b5-ea1b-432c-ac74-def9260a24c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3197eac694784dd6bff647edd9e49582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:01:34Z,use_quota=True,user_id='4abcde3dd0b34fba8f492d431f7a7696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Creating volume 8d9753b5-ea1b-432c-ac74-def9260a24c6 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:01:34 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:34 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6 1073741824 Jul 10 05:01:34 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:34 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-89ffc0be-5c25-4f8e-b0e8-66fe8afdb590 tempest-ProjectMemberTests-1536548769 None] Create snapshot completed successfully Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cda885a1-7494-406d-ad6c-b716f6264216 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-9f923495-3bc6-418a-871f-10d615b946a6-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cda885a1-7494-406d-ad6c-b716f6264216 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-9f923495-3bc6-418a-871f-10d615b946a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cda885a1-7494-406d-ad6c-b716f6264216 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-18c30f75-0ad5-4dca-af9e-6548f07a2c27" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cda885a1-7494-406d-ad6c-b716f6264216 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-18c30f75-0ad5-4dca-af9e-6548f07a2c27" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cda885a1-7494-406d-ad6c-b716f6264216 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-9f923495-3bc6-418a-871f-10d615b946a6" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cda885a1-7494-406d-ad6c-b716f6264216 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-9f923495-3bc6-418a-871f-10d615b946a6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-cda885a1-7494-406d-ad6c-b716f6264216 tempest-ProjectMemberTests-1536548769 None] Deleting offline snapshot 9f923495-3bc6-418a-871f-10d615b946a6 of volume 18c30f75-0ad5-4dca-af9e-6548f07a2c27 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-cda885a1-7494-406d-ad6c-b716f6264216 tempest-ProjectMemberTests-1536548769 None] snapshot_file for this snap is: volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.9f923495-3bc6-418a-871f-10d615b946a6 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e8dd04-2bf9-43c0-9e10-28790533538c]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cda885a1-7494-406d-ad6c-b716f6264216 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.9f923495-3bc6-418a-871f-10d615b946a6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:34 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.9f923495-3bc6-418a-871f-10d615b946a6 Jul 10 05:01:34 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:34 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6 1073741824" returned: 0 in 0.925s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:35 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6 Jul 10 05:01:35 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:35 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cda885a1-7494-406d-ad6c-b716f6264216 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.9f923495-3bc6-418a-871f-10d615b946a6" returned: 0 in 0.837s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-cda885a1-7494-406d-ad6c-b716f6264216 tempest-ProjectMemberTests-1536548769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:01:35 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d7aacc-5bf9-40a9-8755-f6a0a79af4e3]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cda885a1-7494-406d-ad6c-b716f6264216 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-16cbe613-a13a-4a91-86b0-572c09ddcc79 tempest-ProjectAdminTests-1123751752 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87359) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4881}} Jul 10 05:01:35 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27 Jul 10 05:01:35 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:35 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6" returned: 0 in 0.700s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:35 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:01:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d583ca81-4efb-4f69-b33a-158a7028f8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d9753b5-ea1b-432c-ac74-def9260a24c6', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1614712e-8963-4e87-97dc-f202e9001212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:35 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Volume volume-8d9753b5-ea1b-432c-ac74-def9260a24c6 (8d9753b5-ea1b-432c-ac74-def9260a24c6): created successfully Jul 10 05:01:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1614712e-8963-4e87-97dc-f202e9001212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:35 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Flow 'volume_create_manager' (f687dd9b-0aef-4e34-9b79-442f9f60e5fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:01:35 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ef322abb-9902-4fd7-8129-0f3254f9dd86 tempest-ProjectReaderTests-849381127 None] Created volume successfully. Jul 10 05:01:36 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cda885a1-7494-406d-ad6c-b716f6264216 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27" returned: 0 in 0.791s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cda885a1-7494-406d-ad6c-b716f6264216 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.9f923495-3bc6-418a-871f-10d615b946a6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:36 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.9f923495-3bc6-418a-871f-10d615b946a6 Jul 10 05:01:36 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:36 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cda885a1-7494-406d-ad6c-b716f6264216 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.9f923495-3bc6-418a-871f-10d615b946a6" returned: 0 in 0.823s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cda885a1-7494-406d-ad6c-b716f6264216 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.9f923495-3bc6-418a-871f-10d615b946a6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:36 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.9f923495-3bc6-418a-871f-10d615b946a6 Jul 10 05:01:36 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-da682ef0-de41-4cbe-8409-af4f3b803d0a tempest-ProjectReaderTests-849381127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-da682ef0-de41-4cbe-8409-af4f3b803d0a tempest-ProjectReaderTests-849381127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-da682ef0-de41-4cbe-8409-af4f3b803d0a tempest-ProjectReaderTests-849381127 None] Creating offline snapshot fef307f9-210b-4eee-9c5b-75dc98ae9c9c of volume 8d9753b5-ea1b-432c-ac74-def9260a24c6 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:01:37 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a122bc-5b7e-431c-bee6-63041b22d37b]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-da682ef0-de41-4cbe-8409-af4f3b803d0a tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:37 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6 Jul 10 05:01:37 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:37 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-cda885a1-7494-406d-ad6c-b716f6264216 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27.9f923495-3bc6-418a-871f-10d615b946a6" returned: 0 in 0.731s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cda885a1-7494-406d-ad6c-b716f6264216 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-9f923495-3bc6-418a-871f-10d615b946a6" released by "_delete_snapshot" :: held 3.299s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cda885a1-7494-406d-ad6c-b716f6264216 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-18c30f75-0ad5-4dca-af9e-6548f07a2c27" released by "delete_snapshot" :: held 3.327s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:37 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-cda885a1-7494-406d-ad6c-b716f6264216 tempest-ProjectMemberTests-1536548769 None] Created reservations ['1932ff04-2022-4cbb-9f60-0e24de2bf31b', '8f3d3a8c-f760-42d2-915d-2348da5f1e38', '6a5f32e2-50dc-42d0-abe2-71b8b6fa23db', '1172f055-84ad-4be3-8fd4-b004af6ae41d'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:01:37 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-cda885a1-7494-406d-ad6c-b716f6264216 tempest-ProjectMemberTests-1536548769 None] Delete snapshot completed successfully. Jul 10 05:01:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-cda885a1-7494-406d-ad6c-b716f6264216 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-9f923495-3bc6-418a-871f-10d615b946a6-delete_snapshot" released by "delete_snapshot" :: held 3.477s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:37 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-da682ef0-de41-4cbe-8409-af4f3b803d0a tempest-ProjectReaderTests-849381127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6" returned: 0 in 0.868s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-da682ef0-de41-4cbe-8409-af4f3b803d0a tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.fef307f9-210b-4eee-9c5b-75dc98ae9c9c 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:38 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.fef307f9-210b-4eee-9c5b-75dc98ae9c9c 1G Jul 10 05:01:38 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7442055a-8b07-42cc-bc9e-6c835516ea77 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-18c30f75-0ad5-4dca-af9e-6548f07a2c27-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7442055a-8b07-42cc-bc9e-6c835516ea77 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-18c30f75-0ad5-4dca-af9e-6548f07a2c27-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7442055a-8b07-42cc-bc9e-6c835516ea77 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-18c30f75-0ad5-4dca-af9e-6548f07a2c27" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:38 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7442055a-8b07-42cc-bc9e-6c835516ea77 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-18c30f75-0ad5-4dca-af9e-6548f07a2c27" acquired by "delete_volume" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:38 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fdf0c5-eba2-416f-afa5-107a4d5b3dad]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7442055a-8b07-42cc-bc9e-6c835516ea77 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:38 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27 Jul 10 05:01:38 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:38 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-da682ef0-de41-4cbe-8409-af4f3b803d0a tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.fef307f9-210b-4eee-9c5b-75dc98ae9c9c 1G" returned: 0 in 0.923s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-da682ef0-de41-4cbe-8409-af4f3b803d0a tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d9753b5-ea1b-432c-ac74-def9260a24c6 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.fef307f9-210b-4eee-9c5b-75dc98ae9c9c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:38 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d9753b5-ea1b-432c-ac74-def9260a24c6 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.fef307f9-210b-4eee-9c5b-75dc98ae9c9c Jul 10 05:01:38 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:39 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7442055a-8b07-42cc-bc9e-6c835516ea77 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27" returned: 0 in 0.793s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7442055a-8b07-42cc-bc9e-6c835516ea77 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:39 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27 Jul 10 05:01:39 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:39 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-da682ef0-de41-4cbe-8409-af4f3b803d0a tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d9753b5-ea1b-432c-ac74-def9260a24c6 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.fef307f9-210b-4eee-9c5b-75dc98ae9c9c" returned: 0 in 0.761s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:39 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-da682ef0-de41-4cbe-8409-af4f3b803d0a tempest-ProjectReaderTests-849381127 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.fef307f9-210b-4eee-9c5b-75dc98ae9c9c is being set with open permissions: ugo+rw Jul 10 05:01:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-da682ef0-de41-4cbe-8409-af4f3b803d0a tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.fef307f9-210b-4eee-9c5b-75dc98ae9c9c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:39 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.fef307f9-210b-4eee-9c5b-75dc98ae9c9c Jul 10 05:01:39 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:40 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7442055a-8b07-42cc-bc9e-6c835516ea77 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-18c30f75-0ad5-4dca-af9e-6548f07a2c27" returned: 0 in 0.686s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:40 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7442055a-8b07-42cc-bc9e-6c835516ea77 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-18c30f75-0ad5-4dca-af9e-6548f07a2c27" released by "delete_volume" :: held 1.544s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:40 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=197,cinder:DELETE=15,cinder:SELECT=139,cinder:INSERT=64 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:01:40 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=147,cinder:UPDATE=187,cinder:DELETE=18,cinder:INSERT=43 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:01:40 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-da682ef0-de41-4cbe-8409-af4f3b803d0a tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.fef307f9-210b-4eee-9c5b-75dc98ae9c9c" returned: 0 in 0.651s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-da682ef0-de41-4cbe-8409-af4f3b803d0a tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:40 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.info Jul 10 05:01:40 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:40 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-7442055a-8b07-42cc-bc9e-6c835516ea77 tempest-ProjectMemberTests-1536548769 None] Created reservations ['80a67d58-075a-40d2-ad00-9cfbab3ca5df', '31def5f0-fa77-48d4-b1ae-6ef6c74f9868', '48add8ef-bb21-462a-adcb-0756630abc97', 'a6735f1e-e856-4e69-9a3d-288ad1003165'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:01:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7442055a-8b07-42cc-bc9e-6c835516ea77 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7442055a-8b07-42cc-bc9e-6c835516ea77 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7442055a-8b07-42cc-bc9e-6c835516ea77 tempest-ProjectMemberTests-1536548769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:01:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7442055a-8b07-42cc-bc9e-6c835516ea77 tempest-ProjectMemberTests-1536548769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:01:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7442055a-8b07-42cc-bc9e-6c835516ea77 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7442055a-8b07-42cc-bc9e-6c835516ea77 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:40 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:01:40 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:41 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-da682ef0-de41-4cbe-8409-af4f3b803d0a tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.info" returned: 0 in 0.756s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:41 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-da682ef0-de41-4cbe-8409-af4f3b803d0a tempest-ProjectReaderTests-849381127 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.info is being set with open permissions: ugo+rw Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-da682ef0-de41-4cbe-8409-af4f3b803d0a tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:41 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.info Jul 10 05:01:41 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:41 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7442055a-8b07-42cc-bc9e-6c835516ea77 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.700s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-7442055a-8b07-42cc-bc9e-6c835516ea77 tempest-ProjectMemberTests-1536548769 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:01:41 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-7442055a-8b07-42cc-bc9e-6c835516ea77 tempest-ProjectMemberTests-1536548769 None] Deleted volume successfully. Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7442055a-8b07-42cc-bc9e-6c835516ea77 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-18c30f75-0ad5-4dca-af9e-6548f07a2c27-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Flow 'volume_create_manager' (6715e19e-284a-4c34-bf92-623914717b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec25a08a-f04d-4a09-9945-6e1d6a835e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec25a08a-f04d-4a09-9945-6e1d6a835e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1619256970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43724fb1-eecf-46aa-8234-188dd00f10e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4b418f932c4d1f8f37edd3cc0b7dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:01:42Z,use_quota=True,user_id='124e0cf464a84f5ab1b9058b1a0fffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2ed2ec-3e03-4483-aa6d-423419736669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2ed2ec-3e03-4483-aa6d-423419736669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f287492-46b6-4752-8990-f31a4164d9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f287492-46b6-4752-8990-f31a4164d9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43724fb1-eecf-46aa-8234-188dd00f10e3', 'volume_name': 'volume-43724fb1-eecf-46aa-8234-188dd00f10e3', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf8baf4d-f0dd-4e04-b819-ace9d39b5054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf8baf4d-f0dd-4e04-b819-ace9d39b5054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ea7480-e1cd-4711-8e1a-d29fbd7ed73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:41 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Volume 43724fb1-eecf-46aa-8234-188dd00f10e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43724fb1-eecf-46aa-8234-188dd00f10e3', 'volume_size': 1} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:41 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-da682ef0-de41-4cbe-8409-af4f3b803d0a tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.info" returned: 0 in 0.689s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-da682ef0-de41-4cbe-8409-af4f3b803d0a tempest-ProjectReaderTests-849381127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.742s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.074s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1619256970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43724fb1-eecf-46aa-8234-188dd00f10e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4b418f932c4d1f8f37edd3cc0b7dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:01:42Z,use_quota=True,user_id='124e0cf464a84f5ab1b9058b1a0fffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Creating volume 43724fb1-eecf-46aa-8234-188dd00f10e3 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:01:41 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:01:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:41 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3 1073741824 Jul 10 05:01:41 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:41 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-da682ef0-de41-4cbe-8409-af4f3b803d0a tempest-ProjectReaderTests-849381127 None] Create snapshot completed successfully Jul 10 05:01:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-97cde69a-b1b9-4699-958c-bd7a8c451015 tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-fef307f9-210b-4eee-9c5b-75dc98ae9c9c-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-97cde69a-b1b9-4699-958c-bd7a8c451015 tempest-ProjectReaderTests-849381127 None] Lock "cinder-fef307f9-210b-4eee-9c5b-75dc98ae9c9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-97cde69a-b1b9-4699-958c-bd7a8c451015 tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-quobyte-8d9753b5-ea1b-432c-ac74-def9260a24c6" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-97cde69a-b1b9-4699-958c-bd7a8c451015 tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-8d9753b5-ea1b-432c-ac74-def9260a24c6" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-97cde69a-b1b9-4699-958c-bd7a8c451015 tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-quobyte-fef307f9-210b-4eee-9c5b-75dc98ae9c9c" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-97cde69a-b1b9-4699-958c-bd7a8c451015 tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-fef307f9-210b-4eee-9c5b-75dc98ae9c9c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-97cde69a-b1b9-4699-958c-bd7a8c451015 tempest-ProjectReaderTests-849381127 None] Deleting offline snapshot fef307f9-210b-4eee-9c5b-75dc98ae9c9c of volume 8d9753b5-ea1b-432c-ac74-def9260a24c6 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:01:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-97cde69a-b1b9-4699-958c-bd7a8c451015 tempest-ProjectReaderTests-849381127 None] snapshot_file for this snap is: volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.fef307f9-210b-4eee-9c5b-75dc98ae9c9c {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:01:42 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[67444a11-8492-4cf0-9604-c60aeb4d129e]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-97cde69a-b1b9-4699-958c-bd7a8c451015 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.fef307f9-210b-4eee-9c5b-75dc98ae9c9c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:42 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.fef307f9-210b-4eee-9c5b-75dc98ae9c9c Jul 10 05:01:42 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:42 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3 1073741824" returned: 0 in 0.977s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:42 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3 Jul 10 05:01:42 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:43 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-97cde69a-b1b9-4699-958c-bd7a8c451015 tempest-ProjectReaderTests-849381127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.fef307f9-210b-4eee-9c5b-75dc98ae9c9c" returned: 0 in 0.833s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:43 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-97cde69a-b1b9-4699-958c-bd7a8c451015 tempest-ProjectReaderTests-849381127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d9753b5-ea1b-432c-ac74-def9260a24c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:01:43 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d941a17-6943-4a85-9ad6-9986743d8917]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-97cde69a-b1b9-4699-958c-bd7a8c451015 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:43 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6 Jul 10 05:01:43 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:43 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3" returned: 0 in 0.695s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:43 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:01:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ea7480-e1cd-4711-8e1a-d29fbd7ed73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43724fb1-eecf-46aa-8234-188dd00f10e3', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a192be-b629-4018-b609-3715cc2ee103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:43 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Volume volume-43724fb1-eecf-46aa-8234-188dd00f10e3 (43724fb1-eecf-46aa-8234-188dd00f10e3): created successfully Jul 10 05:01:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a192be-b629-4018-b609-3715cc2ee103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Flow 'volume_create_manager' (6715e19e-284a-4c34-bf92-623914717b3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:01:43 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ed694ad7-051e-496f-9141-8791533a09cc tempest-ProjectMemberTests-1536548769 None] Created volume successfully. Jul 10 05:01:44 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-97cde69a-b1b9-4699-958c-bd7a8c451015 tempest-ProjectReaderTests-849381127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6" returned: 0 in 0.747s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-97cde69a-b1b9-4699-958c-bd7a8c451015 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.fef307f9-210b-4eee-9c5b-75dc98ae9c9c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:44 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.fef307f9-210b-4eee-9c5b-75dc98ae9c9c Jul 10 05:01:44 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-39b2c439-36eb-43df-947a-c87575a144bb tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-39b2c439-36eb-43df-947a-c87575a144bb tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:44 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-39b2c439-36eb-43df-947a-c87575a144bb tempest-ProjectMemberTests-1536548769 None] Creating offline snapshot 3fa37c85-6312-41c0-bf8b-5bdbc0c8d687 of volume 43724fb1-eecf-46aa-8234-188dd00f10e3 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:01:44 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d23983-99a4-41f7-94d9-f83cc19b508c]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-39b2c439-36eb-43df-947a-c87575a144bb tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:44 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-97cde69a-b1b9-4699-958c-bd7a8c451015 tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.fef307f9-210b-4eee-9c5b-75dc98ae9c9c" returned: 0 in 0.844s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-97cde69a-b1b9-4699-958c-bd7a8c451015 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.fef307f9-210b-4eee-9c5b-75dc98ae9c9c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:45 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.fef307f9-210b-4eee-9c5b-75dc98ae9c9c Jul 10 05:01:45 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:45 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3 Jul 10 05:01:45 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:45 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-39b2c439-36eb-43df-947a-c87575a144bb tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3" returned: 0 in 0.813s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-39b2c439-36eb-43df-947a-c87575a144bb tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.3fa37c85-6312-41c0-bf8b-5bdbc0c8d687 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:45 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-97cde69a-b1b9-4699-958c-bd7a8c451015 tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6.fef307f9-210b-4eee-9c5b-75dc98ae9c9c" returned: 0 in 0.775s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:45 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.3fa37c85-6312-41c0-bf8b-5bdbc0c8d687 1G Jul 10 05:01:45 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:45 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-97cde69a-b1b9-4699-958c-bd7a8c451015 tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-fef307f9-210b-4eee-9c5b-75dc98ae9c9c" released by "_delete_snapshot" :: held 3.298s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:45 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-97cde69a-b1b9-4699-958c-bd7a8c451015 tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-8d9753b5-ea1b-432c-ac74-def9260a24c6" released by "delete_snapshot" :: held 3.323s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:45 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-97cde69a-b1b9-4699-958c-bd7a8c451015 tempest-ProjectReaderTests-849381127 None] Created reservations ['64ec10d0-5f05-4198-aa29-a181e2fa67f6', '3a8745e1-b929-437a-aa65-c93678972b8b', '9ce8f56e-e879-4dcc-af52-78bcfdedfc76', '2dcb1823-9230-4ff2-af43-8339bf34f76f'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:01:45 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-97cde69a-b1b9-4699-958c-bd7a8c451015 tempest-ProjectReaderTests-849381127 None] Delete snapshot completed successfully. Jul 10 05:01:45 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-97cde69a-b1b9-4699-958c-bd7a8c451015 tempest-ProjectReaderTests-849381127 None] Lock "cinder-fef307f9-210b-4eee-9c5b-75dc98ae9c9c-delete_snapshot" released by "delete_snapshot" :: held 3.489s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:46 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-39b2c439-36eb-43df-947a-c87575a144bb tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.3fa37c85-6312-41c0-bf8b-5bdbc0c8d687 1G" returned: 0 in 0.824s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-39b2c439-36eb-43df-947a-c87575a144bb tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43724fb1-eecf-46aa-8234-188dd00f10e3 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.3fa37c85-6312-41c0-bf8b-5bdbc0c8d687 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:46 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43724fb1-eecf-46aa-8234-188dd00f10e3 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.3fa37c85-6312-41c0-bf8b-5bdbc0c8d687 Jul 10 05:01:46 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:46 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-14fc6a7f-c294-4173-bc3a-a02ee1cc8628 tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-8d9753b5-ea1b-432c-ac74-def9260a24c6-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:46 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-14fc6a7f-c294-4173-bc3a-a02ee1cc8628 tempest-ProjectReaderTests-849381127 None] Lock "cinder-8d9753b5-ea1b-432c-ac74-def9260a24c6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:46 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-14fc6a7f-c294-4173-bc3a-a02ee1cc8628 tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-quobyte-8d9753b5-ea1b-432c-ac74-def9260a24c6" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:46 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-14fc6a7f-c294-4173-bc3a-a02ee1cc8628 tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-8d9753b5-ea1b-432c-ac74-def9260a24c6" acquired by "delete_volume" :: waited 0.022s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:46 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f7a97a-a45f-4302-9645-34be7b157e28]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-14fc6a7f-c294-4173-bc3a-a02ee1cc8628 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:46 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6 Jul 10 05:01:46 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:47 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-39b2c439-36eb-43df-947a-c87575a144bb tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43724fb1-eecf-46aa-8234-188dd00f10e3 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.3fa37c85-6312-41c0-bf8b-5bdbc0c8d687" returned: 0 in 0.689s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:47 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-39b2c439-36eb-43df-947a-c87575a144bb tempest-ProjectMemberTests-1536548769 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.3fa37c85-6312-41c0-bf8b-5bdbc0c8d687 is being set with open permissions: ugo+rw Jul 10 05:01:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-39b2c439-36eb-43df-947a-c87575a144bb tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.3fa37c85-6312-41c0-bf8b-5bdbc0c8d687 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:47 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.3fa37c85-6312-41c0-bf8b-5bdbc0c8d687 Jul 10 05:01:47 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:47 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-14fc6a7f-c294-4173-bc3a-a02ee1cc8628 tempest-ProjectReaderTests-849381127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6" returned: 0 in 0.778s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-14fc6a7f-c294-4173-bc3a-a02ee1cc8628 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:47 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6 Jul 10 05:01:47 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:47 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-39b2c439-36eb-43df-947a-c87575a144bb tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.3fa37c85-6312-41c0-bf8b-5bdbc0c8d687" returned: 0 in 0.652s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-39b2c439-36eb-43df-947a-c87575a144bb tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:47 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.info Jul 10 05:01:47 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:48 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-14fc6a7f-c294-4173-bc3a-a02ee1cc8628 tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-8d9753b5-ea1b-432c-ac74-def9260a24c6" returned: 0 in 0.681s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:48 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-14fc6a7f-c294-4173-bc3a-a02ee1cc8628 tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-8d9753b5-ea1b-432c-ac74-def9260a24c6" released by "delete_volume" :: held 1.522s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:48 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-14fc6a7f-c294-4173-bc3a-a02ee1cc8628 tempest-ProjectReaderTests-849381127 None] Created reservations ['6b5d1e08-fb58-40a7-81e4-738b9066feaf', 'd8310070-9d13-491c-8dec-6f51f8cf556b', '616273d5-5872-400d-8ce6-5b2abcccada8', 'fd420d55-d245-4936-936c-4cc54cc1f50b'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:01:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-14fc6a7f-c294-4173-bc3a-a02ee1cc8628 tempest-ProjectReaderTests-849381127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-14fc6a7f-c294-4173-bc3a-a02ee1cc8628 tempest-ProjectReaderTests-849381127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-14fc6a7f-c294-4173-bc3a-a02ee1cc8628 tempest-ProjectReaderTests-849381127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:01:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-14fc6a7f-c294-4173-bc3a-a02ee1cc8628 tempest-ProjectReaderTests-849381127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:01:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-14fc6a7f-c294-4173-bc3a-a02ee1cc8628 tempest-ProjectReaderTests-849381127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-14fc6a7f-c294-4173-bc3a-a02ee1cc8628 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:48 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:01:48 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:48 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-39b2c439-36eb-43df-947a-c87575a144bb tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.info" returned: 0 in 0.646s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:48 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-39b2c439-36eb-43df-947a-c87575a144bb tempest-ProjectMemberTests-1536548769 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.info is being set with open permissions: ugo+rw Jul 10 05:01:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-39b2c439-36eb-43df-947a-c87575a144bb tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:48 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.info Jul 10 05:01:48 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:49 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-14fc6a7f-c294-4173-bc3a-a02ee1cc8628 tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.655s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-14fc6a7f-c294-4173-bc3a-a02ee1cc8628 tempest-ProjectReaderTests-849381127 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:01:49 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-14fc6a7f-c294-4173-bc3a-a02ee1cc8628 tempest-ProjectReaderTests-849381127 None] Deleted volume successfully. Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-14fc6a7f-c294-4173-bc3a-a02ee1cc8628 tempest-ProjectReaderTests-849381127 None] Lock "cinder-8d9753b5-ea1b-432c-ac74-def9260a24c6-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:49 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-39b2c439-36eb-43df-947a-c87575a144bb tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.info" returned: 0 in 0.645s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-39b2c439-36eb-43df-947a-c87575a144bb tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.373s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:49 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-39b2c439-36eb-43df-947a-c87575a144bb tempest-ProjectMemberTests-1536548769 None] Create snapshot completed successfully Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Flow 'volume_create_manager' (20fb193f-b55b-4025-be55-630b6228818f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3377e60-c6b6-4545-af9e-1ba7d90cf762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3377e60-c6b6-4545-af9e-1ba7d90cf762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-121094019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af12b22d-43e3-4c45-b7da-cf7357511f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3197eac694784dd6bff647edd9e49582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:01:49Z,use_quota=True,user_id='4abcde3dd0b34fba8f492d431f7a7696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef102cd-d2d2-4b03-b4b8-8276d0e66aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef102cd-d2d2-4b03-b4b8-8276d0e66aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1288c52f-4ba9-4d81-90c1-7dcc37e4681f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1288c52f-4ba9-4d81-90c1-7dcc37e4681f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af12b22d-43e3-4c45-b7da-cf7357511f6b', 'volume_name': 'volume-af12b22d-43e3-4c45-b7da-cf7357511f6b', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e825674-9088-4eb7-b600-83aac5c32a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e825674-9088-4eb7-b600-83aac5c32a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f5be26-ad98-4e40-b97b-a15c5f9e4ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:49 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Volume af12b22d-43e3-4c45-b7da-cf7357511f6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af12b22d-43e3-4c45-b7da-cf7357511f6b', 'volume_size': 1} Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-121094019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af12b22d-43e3-4c45-b7da-cf7357511f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3197eac694784dd6bff647edd9e49582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:01:49Z,use_quota=True,user_id='4abcde3dd0b34fba8f492d431f7a7696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Creating volume af12b22d-43e3-4c45-b7da-cf7357511f6b {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:01:49 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:01:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:49 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b 1073741824 Jul 10 05:01:49 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-223d35b8-88cf-4e6a-8594-01a9ddff7c34 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-3fa37c85-6312-41c0-bf8b-5bdbc0c8d687-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-223d35b8-88cf-4e6a-8594-01a9ddff7c34 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-3fa37c85-6312-41c0-bf8b-5bdbc0c8d687-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-223d35b8-88cf-4e6a-8594-01a9ddff7c34 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-43724fb1-eecf-46aa-8234-188dd00f10e3" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-223d35b8-88cf-4e6a-8594-01a9ddff7c34 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-43724fb1-eecf-46aa-8234-188dd00f10e3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-223d35b8-88cf-4e6a-8594-01a9ddff7c34 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-3fa37c85-6312-41c0-bf8b-5bdbc0c8d687" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-223d35b8-88cf-4e6a-8594-01a9ddff7c34 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-3fa37c85-6312-41c0-bf8b-5bdbc0c8d687" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-223d35b8-88cf-4e6a-8594-01a9ddff7c34 tempest-ProjectMemberTests-1536548769 None] Deleting offline snapshot 3fa37c85-6312-41c0-bf8b-5bdbc0c8d687 of volume 43724fb1-eecf-46aa-8234-188dd00f10e3 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:01:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-223d35b8-88cf-4e6a-8594-01a9ddff7c34 tempest-ProjectMemberTests-1536548769 None] snapshot_file for this snap is: volume-43724fb1-eecf-46aa-8234-188dd00f10e3.3fa37c85-6312-41c0-bf8b-5bdbc0c8d687 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:01:50 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b77942-bd88-4eee-b867-4ed51f74f822]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-223d35b8-88cf-4e6a-8594-01a9ddff7c34 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.3fa37c85-6312-41c0-bf8b-5bdbc0c8d687 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:50 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.3fa37c85-6312-41c0-bf8b-5bdbc0c8d687 Jul 10 05:01:50 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:50 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b 1073741824" returned: 0 in 0.863s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:50 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b Jul 10 05:01:50 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:50 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-223d35b8-88cf-4e6a-8594-01a9ddff7c34 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.3fa37c85-6312-41c0-bf8b-5bdbc0c8d687" returned: 0 in 0.766s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:50 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-223d35b8-88cf-4e6a-8594-01a9ddff7c34 tempest-ProjectMemberTests-1536548769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43724fb1-eecf-46aa-8234-188dd00f10e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:01:50 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99e6b47-d553-4ce6-bc84-4bc92dcb43c0]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-223d35b8-88cf-4e6a-8594-01a9ddff7c34 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:51 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b" returned: 0 in 0.660s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:51 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:01:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:51 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f5be26-ad98-4e40-b97b-a15c5f9e4ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af12b22d-43e3-4c45-b7da-cf7357511f6b', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:51 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c7191e-7b8d-429f-afa9-60a40536dbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:51 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Volume volume-af12b22d-43e3-4c45-b7da-cf7357511f6b (af12b22d-43e3-4c45-b7da-cf7357511f6b): created successfully Jul 10 05:01:51 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c7191e-7b8d-429f-afa9-60a40536dbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:51 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Flow 'volume_create_manager' (20fb193f-b55b-4025-be55-630b6228818f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:01:51 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3 Jul 10 05:01:51 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:51 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-743b3b2e-acfe-4689-af6b-16bdfe220722 tempest-ProjectReaderTests-849381127 None] Created volume successfully. Jul 10 05:01:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5888b92-5082-43e1-8099-206e293957fb tempest-ProjectReaderTests-849381127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5888b92-5082-43e1-8099-206e293957fb tempest-ProjectReaderTests-849381127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:51 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d5888b92-5082-43e1-8099-206e293957fb tempest-ProjectReaderTests-849381127 None] Creating offline snapshot 970e2334-0208-4fb4-8b0c-45f7335c42e3 of volume af12b22d-43e3-4c45-b7da-cf7357511f6b {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:01:51 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0f31b2-e75b-4262-a67e-32f1b17e7a1b]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5888b92-5082-43e1-8099-206e293957fb tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:51 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-223d35b8-88cf-4e6a-8594-01a9ddff7c34 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3" returned: 0 in 0.791s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-223d35b8-88cf-4e6a-8594-01a9ddff7c34 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.3fa37c85-6312-41c0-bf8b-5bdbc0c8d687 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:51 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b Jul 10 05:01:51 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:51 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.3fa37c85-6312-41c0-bf8b-5bdbc0c8d687 Jul 10 05:01:51 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:52 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5888b92-5082-43e1-8099-206e293957fb tempest-ProjectReaderTests-849381127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b" returned: 0 in 0.773s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5888b92-5082-43e1-8099-206e293957fb tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.970e2334-0208-4fb4-8b0c-45f7335c42e3 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:52 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.970e2334-0208-4fb4-8b0c-45f7335c42e3 1G Jul 10 05:01:52 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:52 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-223d35b8-88cf-4e6a-8594-01a9ddff7c34 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.3fa37c85-6312-41c0-bf8b-5bdbc0c8d687" returned: 0 in 0.739s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-223d35b8-88cf-4e6a-8594-01a9ddff7c34 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.3fa37c85-6312-41c0-bf8b-5bdbc0c8d687 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:52 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.3fa37c85-6312-41c0-bf8b-5bdbc0c8d687 Jul 10 05:01:52 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:53 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-223d35b8-88cf-4e6a-8594-01a9ddff7c34 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3.3fa37c85-6312-41c0-bf8b-5bdbc0c8d687" returned: 0 in 0.658s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-223d35b8-88cf-4e6a-8594-01a9ddff7c34 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-3fa37c85-6312-41c0-bf8b-5bdbc0c8d687" released by "_delete_snapshot" :: held 3.061s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-223d35b8-88cf-4e6a-8594-01a9ddff7c34 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-43724fb1-eecf-46aa-8234-188dd00f10e3" released by "delete_snapshot" :: held 3.089s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:53 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5888b92-5082-43e1-8099-206e293957fb tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.970e2334-0208-4fb4-8b0c-45f7335c42e3 1G" returned: 0 in 0.810s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5888b92-5082-43e1-8099-206e293957fb tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af12b22d-43e3-4c45-b7da-cf7357511f6b -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.970e2334-0208-4fb4-8b0c-45f7335c42e3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:53 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af12b22d-43e3-4c45-b7da-cf7357511f6b -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.970e2334-0208-4fb4-8b0c-45f7335c42e3 Jul 10 05:01:53 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:53 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-223d35b8-88cf-4e6a-8594-01a9ddff7c34 tempest-ProjectMemberTests-1536548769 None] Created reservations ['57acb6df-2e5b-4187-a043-36caa4db0985', '977ce687-a12b-43a7-9326-6329dfb141c4', 'ccf30126-4041-4bbc-bbc1-3f90f1fdb78f', '23357b49-9b15-4442-bf12-f23825595f96'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:01:53 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-223d35b8-88cf-4e6a-8594-01a9ddff7c34 tempest-ProjectMemberTests-1536548769 None] Delete snapshot completed successfully. Jul 10 05:01:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-223d35b8-88cf-4e6a-8594-01a9ddff7c34 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-3fa37c85-6312-41c0-bf8b-5bdbc0c8d687-delete_snapshot" released by "delete_snapshot" :: held 3.252s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:53 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5888b92-5082-43e1-8099-206e293957fb tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af12b22d-43e3-4c45-b7da-cf7357511f6b -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.970e2334-0208-4fb4-8b0c-45f7335c42e3" returned: 0 in 0.689s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:53 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-d5888b92-5082-43e1-8099-206e293957fb tempest-ProjectReaderTests-849381127 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.970e2334-0208-4fb4-8b0c-45f7335c42e3 is being set with open permissions: ugo+rw Jul 10 05:01:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5888b92-5082-43e1-8099-206e293957fb tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.970e2334-0208-4fb4-8b0c-45f7335c42e3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:53 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.970e2334-0208-4fb4-8b0c-45f7335c42e3 Jul 10 05:01:53 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3bf505ce-1607-4b91-8aef-858096c956b7 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-43724fb1-eecf-46aa-8234-188dd00f10e3-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3bf505ce-1607-4b91-8aef-858096c956b7 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-43724fb1-eecf-46aa-8234-188dd00f10e3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3bf505ce-1607-4b91-8aef-858096c956b7 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-43724fb1-eecf-46aa-8234-188dd00f10e3" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3bf505ce-1607-4b91-8aef-858096c956b7 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-43724fb1-eecf-46aa-8234-188dd00f10e3" acquired by "delete_volume" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:54 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[242fed65-f196-48bb-ab3c-c702864a6193]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3bf505ce-1607-4b91-8aef-858096c956b7 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:54 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3 Jul 10 05:01:54 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:54 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5888b92-5082-43e1-8099-206e293957fb tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.970e2334-0208-4fb4-8b0c-45f7335c42e3" returned: 0 in 0.672s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5888b92-5082-43e1-8099-206e293957fb tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:54 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.info Jul 10 05:01:54 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:55 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3bf505ce-1607-4b91-8aef-858096c956b7 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3" returned: 0 in 0.785s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3bf505ce-1607-4b91-8aef-858096c956b7 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:55 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5888b92-5082-43e1-8099-206e293957fb tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.info" returned: 0 in 0.665s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:55 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-d5888b92-5082-43e1-8099-206e293957fb tempest-ProjectReaderTests-849381127 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.info is being set with open permissions: ugo+rw Jul 10 05:01:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5888b92-5082-43e1-8099-206e293957fb tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:55 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3 Jul 10 05:01:55 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:55 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.info Jul 10 05:01:55 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:55 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3bf505ce-1607-4b91-8aef-858096c956b7 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-43724fb1-eecf-46aa-8234-188dd00f10e3" returned: 0 in 0.666s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3bf505ce-1607-4b91-8aef-858096c956b7 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-43724fb1-eecf-46aa-8234-188dd00f10e3" released by "delete_volume" :: held 1.519s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:55 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d5888b92-5082-43e1-8099-206e293957fb tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.info" returned: 0 in 0.661s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d5888b92-5082-43e1-8099-206e293957fb tempest-ProjectReaderTests-849381127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.347s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:56 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d5888b92-5082-43e1-8099-206e293957fb tempest-ProjectReaderTests-849381127 None] Create snapshot completed successfully Jul 10 05:01:56 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-3bf505ce-1607-4b91-8aef-858096c956b7 tempest-ProjectMemberTests-1536548769 None] Created reservations ['e44975b8-c154-4b17-9bca-3db98ac4fbf2', 'ff919399-bf79-4524-8010-b069b679becc', '81572342-d6e5-4f5e-852a-d133668b4760', '7f0184d2-e5ff-4dd2-8179-fac42726b42d'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:01:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3bf505ce-1607-4b91-8aef-858096c956b7 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3bf505ce-1607-4b91-8aef-858096c956b7 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3bf505ce-1607-4b91-8aef-858096c956b7 tempest-ProjectMemberTests-1536548769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:01:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-3bf505ce-1607-4b91-8aef-858096c956b7 tempest-ProjectMemberTests-1536548769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:01:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3bf505ce-1607-4b91-8aef-858096c956b7 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3bf505ce-1607-4b91-8aef-858096c956b7 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:56 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:01:56 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:56 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3bf505ce-1607-4b91-8aef-858096c956b7 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.646s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:56 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-3bf505ce-1607-4b91-8aef-858096c956b7 tempest-ProjectMemberTests-1536548769 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:01:56 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-3bf505ce-1607-4b91-8aef-858096c956b7 tempest-ProjectMemberTests-1536548769 None] Deleted volume successfully. Jul 10 05:01:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-3bf505ce-1607-4b91-8aef-858096c956b7 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-43724fb1-eecf-46aa-8234-188dd00f10e3-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:01:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a45a2ff8-84cb-4821-b9c6-c11d8c09af3f tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-970e2334-0208-4fb4-8b0c-45f7335c42e3-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a45a2ff8-84cb-4821-b9c6-c11d8c09af3f tempest-ProjectReaderTests-849381127 None] Lock "cinder-970e2334-0208-4fb4-8b0c-45f7335c42e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a45a2ff8-84cb-4821-b9c6-c11d8c09af3f tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-quobyte-af12b22d-43e3-4c45-b7da-cf7357511f6b" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a45a2ff8-84cb-4821-b9c6-c11d8c09af3f tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-af12b22d-43e3-4c45-b7da-cf7357511f6b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a45a2ff8-84cb-4821-b9c6-c11d8c09af3f tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-quobyte-970e2334-0208-4fb4-8b0c-45f7335c42e3" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:01:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a45a2ff8-84cb-4821-b9c6-c11d8c09af3f tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-970e2334-0208-4fb4-8b0c-45f7335c42e3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:01:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a45a2ff8-84cb-4821-b9c6-c11d8c09af3f tempest-ProjectReaderTests-849381127 None] Deleting offline snapshot 970e2334-0208-4fb4-8b0c-45f7335c42e3 of volume af12b22d-43e3-4c45-b7da-cf7357511f6b {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:01:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a45a2ff8-84cb-4821-b9c6-c11d8c09af3f tempest-ProjectReaderTests-849381127 None] snapshot_file for this snap is: volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.970e2334-0208-4fb4-8b0c-45f7335c42e3 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:01:56 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf9ec1e-c817-4a21-bb41-fa2618619537]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a45a2ff8-84cb-4821-b9c6-c11d8c09af3f tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.970e2334-0208-4fb4-8b0c-45f7335c42e3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Flow 'volume_create_manager' (ed8df14e-24eb-45d4-8d31-ea5973c52964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab486274-f2b2-42d6-855b-cff8ced9c0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab486274-f2b2-42d6-855b-cff8ced9c0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1341149262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0a8be2-6039-4bf9-afc6-31937bc6823a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4b418f932c4d1f8f37edd3cc0b7dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:01:57Z,use_quota=True,user_id='124e0cf464a84f5ab1b9058b1a0fffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a1dd23-670a-41ff-8551-e9cd48c6bec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a1dd23-670a-41ff-8551-e9cd48c6bec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ffde8b-5b51-4a47-bfbd-3490056add1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ffde8b-5b51-4a47-bfbd-3490056add1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf0a8be2-6039-4bf9-afc6-31937bc6823a', 'volume_name': 'volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bca905a-50a6-4e08-806b-472adf81213d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bca905a-50a6-4e08-806b-472adf81213d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:57 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.970e2334-0208-4fb4-8b0c-45f7335c42e3 Jul 10 05:01:57 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3c3f5e-a8d5-416a-a2cd-e43734be77fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:57 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Volume bf0a8be2-6039-4bf9-afc6-31937bc6823a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a', 'volume_size': 1} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1341149262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0a8be2-6039-4bf9-afc6-31937bc6823a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4b418f932c4d1f8f37edd3cc0b7dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:01:57Z,use_quota=True,user_id='124e0cf464a84f5ab1b9058b1a0fffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Creating volume bf0a8be2-6039-4bf9-afc6-31937bc6823a {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:01:57 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:57 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a 1073741824 Jul 10 05:01:57 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:57 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a45a2ff8-84cb-4821-b9c6-c11d8c09af3f tempest-ProjectReaderTests-849381127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.970e2334-0208-4fb4-8b0c-45f7335c42e3" returned: 0 in 0.794s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a45a2ff8-84cb-4821-b9c6-c11d8c09af3f tempest-ProjectReaderTests-849381127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af12b22d-43e3-4c45-b7da-cf7357511f6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[408f3b29-6ff5-443e-810a-3f7b9c335637]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a45a2ff8-84cb-4821-b9c6-c11d8c09af3f tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:57 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b Jul 10 05:01:57 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:57 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a 1073741824" returned: 0 in 0.868s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:58 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a Jul 10 05:01:58 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:58 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a45a2ff8-84cb-4821-b9c6-c11d8c09af3f tempest-ProjectReaderTests-849381127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b" returned: 0 in 0.789s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a45a2ff8-84cb-4821-b9c6-c11d8c09af3f tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.970e2334-0208-4fb4-8b0c-45f7335c42e3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:58 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.970e2334-0208-4fb4-8b0c-45f7335c42e3 Jul 10 05:01:58 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:58 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a" returned: 0 in 0.644s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:58 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:01:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:01:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3c3f5e-a8d5-416a-a2cd-e43734be77fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1fa601f-678e-4265-9e28-6c67105cab78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:01:58 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Volume volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a (bf0a8be2-6039-4bf9-afc6-31937bc6823a): created successfully Jul 10 05:01:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1fa601f-678e-4265-9e28-6c67105cab78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:01:58 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Flow 'volume_create_manager' (ed8df14e-24eb-45d4-8d31-ea5973c52964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:01:58 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-60200590-44d6-41c2-adc6-49446a73e70f tempest-ProjectMemberTests-1536548769 None] Created volume successfully. Jul 10 05:01:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a0b6c9d3-09bf-45f3-8cf3-e5d298f41c29 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:01:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a0b6c9d3-09bf-45f3-8cf3-e5d298f41c29 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:01:59 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a0b6c9d3-09bf-45f3-8cf3-e5d298f41c29 tempest-ProjectMemberTests-1536548769 None] Creating offline snapshot 2cc18960-dab8-4351-9008-a24cf3fad9c6 of volume bf0a8be2-6039-4bf9-afc6-31937bc6823a {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:01:59 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f47b271-c832-4081-80c0-aaa73f067de9]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:01:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a0b6c9d3-09bf-45f3-8cf3-e5d298f41c29 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:59 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Jul 10 05:01:59 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a Jul 10 05:01:59 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:01:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a45a2ff8-84cb-4821-b9c6-c11d8c09af3f tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.970e2334-0208-4fb4-8b0c-45f7335c42e3" returned: 0 in 0.762s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:01:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a45a2ff8-84cb-4821-b9c6-c11d8c09af3f tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.970e2334-0208-4fb4-8b0c-45f7335c42e3 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:01:59 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.970e2334-0208-4fb4-8b0c-45f7335c42e3 Jul 10 05:01:59 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:00 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a0b6c9d3-09bf-45f3-8cf3-e5d298f41c29 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a" returned: 0 in 0.761s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a0b6c9d3-09bf-45f3-8cf3-e5d298f41c29 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.2cc18960-dab8-4351-9008-a24cf3fad9c6 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:00 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a45a2ff8-84cb-4821-b9c6-c11d8c09af3f tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b.970e2334-0208-4fb4-8b0c-45f7335c42e3" returned: 0 in 0.661s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:00 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.2cc18960-dab8-4351-9008-a24cf3fad9c6 1G Jul 10 05:02:00 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:00 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a45a2ff8-84cb-4821-b9c6-c11d8c09af3f tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-970e2334-0208-4fb4-8b0c-45f7335c42e3" released by "_delete_snapshot" :: held 3.124s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:00 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a45a2ff8-84cb-4821-b9c6-c11d8c09af3f tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-af12b22d-43e3-4c45-b7da-cf7357511f6b" released by "delete_snapshot" :: held 3.148s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:00 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-a45a2ff8-84cb-4821-b9c6-c11d8c09af3f tempest-ProjectReaderTests-849381127 None] Created reservations ['d85962ee-cda8-4d56-b47a-183880f832b5', '8187a216-ac32-4ab6-a50f-3e103c225281', 'f22676b0-d0a2-4fd0-a1f0-22766fba26a3', '87996477-8a22-4009-a7d1-f84849ad8c0e'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:02:00 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a45a2ff8-84cb-4821-b9c6-c11d8c09af3f tempest-ProjectReaderTests-849381127 None] Delete snapshot completed successfully. Jul 10 05:02:00 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-a45a2ff8-84cb-4821-b9c6-c11d8c09af3f tempest-ProjectReaderTests-849381127 None] Lock "cinder-970e2334-0208-4fb4-8b0c-45f7335c42e3-delete_snapshot" released by "delete_snapshot" :: held 3.280s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:00 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a0b6c9d3-09bf-45f3-8cf3-e5d298f41c29 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.2cc18960-dab8-4351-9008-a24cf3fad9c6 1G" returned: 0 in 0.798s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a0b6c9d3-09bf-45f3-8cf3-e5d298f41c29 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.2cc18960-dab8-4351-9008-a24cf3fad9c6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:00 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.2cc18960-dab8-4351-9008-a24cf3fad9c6 Jul 10 05:02:00 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-46c358d2-1c6c-49ea-9c65-99c6e4142300 tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-af12b22d-43e3-4c45-b7da-cf7357511f6b-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-46c358d2-1c6c-49ea-9c65-99c6e4142300 tempest-ProjectReaderTests-849381127 None] Lock "cinder-af12b22d-43e3-4c45-b7da-cf7357511f6b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-46c358d2-1c6c-49ea-9c65-99c6e4142300 tempest-ProjectReaderTests-849381127 None] Acquiring lock "cinder-quobyte-af12b22d-43e3-4c45-b7da-cf7357511f6b" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-46c358d2-1c6c-49ea-9c65-99c6e4142300 tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-af12b22d-43e3-4c45-b7da-cf7357511f6b" acquired by "delete_volume" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:01 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5d12fd-1475-4065-8c63-377bd7893b12]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:02:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-46c358d2-1c6c-49ea-9c65-99c6e4142300 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:01 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b Jul 10 05:02:01 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:01 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a0b6c9d3-09bf-45f3-8cf3-e5d298f41c29 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.2cc18960-dab8-4351-9008-a24cf3fad9c6" returned: 0 in 0.723s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:01 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-a0b6c9d3-09bf-45f3-8cf3-e5d298f41c29 tempest-ProjectMemberTests-1536548769 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.2cc18960-dab8-4351-9008-a24cf3fad9c6 is being set with open permissions: ugo+rw Jul 10 05:02:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a0b6c9d3-09bf-45f3-8cf3-e5d298f41c29 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.2cc18960-dab8-4351-9008-a24cf3fad9c6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:01 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.2cc18960-dab8-4351-9008-a24cf3fad9c6 Jul 10 05:02:01 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:02 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-46c358d2-1c6c-49ea-9c65-99c6e4142300 tempest-ProjectReaderTests-849381127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b" returned: 0 in 0.757s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-46c358d2-1c6c-49ea-9c65-99c6e4142300 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:02 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b Jul 10 05:02:02 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:02 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a0b6c9d3-09bf-45f3-8cf3-e5d298f41c29 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.2cc18960-dab8-4351-9008-a24cf3fad9c6" returned: 0 in 0.655s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a0b6c9d3-09bf-45f3-8cf3-e5d298f41c29 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:02 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.info Jul 10 05:02:02 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:02 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-46c358d2-1c6c-49ea-9c65-99c6e4142300 tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-af12b22d-43e3-4c45-b7da-cf7357511f6b" returned: 0 in 0.656s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:02 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-46c358d2-1c6c-49ea-9c65-99c6e4142300 tempest-ProjectReaderTests-849381127 None] Lock "cinder-quobyte-af12b22d-43e3-4c45-b7da-cf7357511f6b" released by "delete_volume" :: held 1.484s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:02 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-46c358d2-1c6c-49ea-9c65-99c6e4142300 tempest-ProjectReaderTests-849381127 None] Created reservations ['045f0ec1-56db-448e-b0b8-1f9af40a54b3', '878e5f3e-a6cf-4e98-b363-64735103971b', 'bcc21a80-0761-4d3d-ab48-b9df481c2a11', '0b146d86-0cad-4a25-a859-8c73221e4234'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:02:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-46c358d2-1c6c-49ea-9c65-99c6e4142300 tempest-ProjectReaderTests-849381127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-46c358d2-1c6c-49ea-9c65-99c6e4142300 tempest-ProjectReaderTests-849381127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-46c358d2-1c6c-49ea-9c65-99c6e4142300 tempest-ProjectReaderTests-849381127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:02:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-46c358d2-1c6c-49ea-9c65-99c6e4142300 tempest-ProjectReaderTests-849381127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:02:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-46c358d2-1c6c-49ea-9c65-99c6e4142300 tempest-ProjectReaderTests-849381127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-46c358d2-1c6c-49ea-9c65-99c6e4142300 tempest-ProjectReaderTests-849381127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:02 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:02:02 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:02 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a0b6c9d3-09bf-45f3-8cf3-e5d298f41c29 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.info" returned: 0 in 0.683s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:02 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-a0b6c9d3-09bf-45f3-8cf3-e5d298f41c29 tempest-ProjectMemberTests-1536548769 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.info is being set with open permissions: ugo+rw Jul 10 05:02:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a0b6c9d3-09bf-45f3-8cf3-e5d298f41c29 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:02 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.info Jul 10 05:02:02 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:03 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-46c358d2-1c6c-49ea-9c65-99c6e4142300 tempest-ProjectReaderTests-849381127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.660s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:03 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-46c358d2-1c6c-49ea-9c65-99c6e4142300 tempest-ProjectReaderTests-849381127 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:02:03 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-46c358d2-1c6c-49ea-9c65-99c6e4142300 tempest-ProjectReaderTests-849381127 None] Deleted volume successfully. Jul 10 05:02:03 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-46c358d2-1c6c-49ea-9c65-99c6e4142300 tempest-ProjectReaderTests-849381127 None] Lock "cinder-af12b22d-43e3-4c45-b7da-cf7357511f6b-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:03 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a0b6c9d3-09bf-45f3-8cf3-e5d298f41c29 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.info" returned: 0 in 0.687s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a0b6c9d3-09bf-45f3-8cf3-e5d298f41c29 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.398s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:03 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a0b6c9d3-09bf-45f3-8cf3-e5d298f41c29 tempest-ProjectMemberTests-1536548769 None] Create snapshot completed successfully Jul 10 05:02:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-fb9faa98-4818-4be6-956d-deae7db2d3fc tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-2cc18960-dab8-4351-9008-a24cf3fad9c6-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-fb9faa98-4818-4be6-956d-deae7db2d3fc tempest-ProjectMemberTests-1536548769 None] Lock "cinder-2cc18960-dab8-4351-9008-a24cf3fad9c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-fb9faa98-4818-4be6-956d-deae7db2d3fc tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-bf0a8be2-6039-4bf9-afc6-31937bc6823a" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-fb9faa98-4818-4be6-956d-deae7db2d3fc tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-bf0a8be2-6039-4bf9-afc6-31937bc6823a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-fb9faa98-4818-4be6-956d-deae7db2d3fc tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-2cc18960-dab8-4351-9008-a24cf3fad9c6" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-fb9faa98-4818-4be6-956d-deae7db2d3fc tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-2cc18960-dab8-4351-9008-a24cf3fad9c6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:04 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-fb9faa98-4818-4be6-956d-deae7db2d3fc tempest-ProjectMemberTests-1536548769 None] Deleting offline snapshot 2cc18960-dab8-4351-9008-a24cf3fad9c6 of volume bf0a8be2-6039-4bf9-afc6-31937bc6823a {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:02:04 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-fb9faa98-4818-4be6-956d-deae7db2d3fc tempest-ProjectMemberTests-1536548769 None] snapshot_file for this snap is: volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.2cc18960-dab8-4351-9008-a24cf3fad9c6 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:02:04 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f76ee6-eef5-4b54-9cb1-da8a2f738b16]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:02:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fb9faa98-4818-4be6-956d-deae7db2d3fc tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.2cc18960-dab8-4351-9008-a24cf3fad9c6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:04 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.2cc18960-dab8-4351-9008-a24cf3fad9c6 Jul 10 05:02:04 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:05 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fb9faa98-4818-4be6-956d-deae7db2d3fc tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.2cc18960-dab8-4351-9008-a24cf3fad9c6" returned: 0 in 0.800s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-fb9faa98-4818-4be6-956d-deae7db2d3fc tempest-ProjectMemberTests-1536548769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:02:05 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec303dae-0d8a-4d67-a6d9-2de2bd2c3b2d]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:02:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fb9faa98-4818-4be6-956d-deae7db2d3fc tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:05 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a Jul 10 05:02:05 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:06 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fb9faa98-4818-4be6-956d-deae7db2d3fc tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a" returned: 0 in 0.832s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fb9faa98-4818-4be6-956d-deae7db2d3fc tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.2cc18960-dab8-4351-9008-a24cf3fad9c6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:06 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.2cc18960-dab8-4351-9008-a24cf3fad9c6 Jul 10 05:02:06 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:06 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fb9faa98-4818-4be6-956d-deae7db2d3fc tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.2cc18960-dab8-4351-9008-a24cf3fad9c6" returned: 0 in 0.763s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fb9faa98-4818-4be6-956d-deae7db2d3fc tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.2cc18960-dab8-4351-9008-a24cf3fad9c6 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:07 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.2cc18960-dab8-4351-9008-a24cf3fad9c6 Jul 10 05:02:07 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:07 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fb9faa98-4818-4be6-956d-deae7db2d3fc tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a.2cc18960-dab8-4351-9008-a24cf3fad9c6" returned: 0 in 0.639s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:07 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-fb9faa98-4818-4be6-956d-deae7db2d3fc tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-2cc18960-dab8-4351-9008-a24cf3fad9c6" released by "_delete_snapshot" :: held 3.139s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:07 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-fb9faa98-4818-4be6-956d-deae7db2d3fc tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-bf0a8be2-6039-4bf9-afc6-31937bc6823a" released by "delete_snapshot" :: held 3.162s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:07 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-fb9faa98-4818-4be6-956d-deae7db2d3fc tempest-ProjectMemberTests-1536548769 None] Created reservations ['4d2333e2-3f2c-49d3-81d0-14f43f839eb3', 'a72da445-6751-4316-ad23-5cd43d0cf5f7', '7563c44a-68f2-4380-9cf1-91fefbe61fcf', 'e7d4cad4-6b6f-476d-8f94-9b618ef87fff'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:02:07 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-fb9faa98-4818-4be6-956d-deae7db2d3fc tempest-ProjectMemberTests-1536548769 None] Delete snapshot completed successfully. Jul 10 05:02:07 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-fb9faa98-4818-4be6-956d-deae7db2d3fc tempest-ProjectMemberTests-1536548769 None] Lock "cinder-2cc18960-dab8-4351-9008-a24cf3fad9c6-delete_snapshot" released by "delete_snapshot" :: held 3.291s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8cf5de99-a676-4dda-adce-4b34e1d8d067 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-bf0a8be2-6039-4bf9-afc6-31937bc6823a-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8cf5de99-a676-4dda-adce-4b34e1d8d067 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-bf0a8be2-6039-4bf9-afc6-31937bc6823a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8cf5de99-a676-4dda-adce-4b34e1d8d067 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-bf0a8be2-6039-4bf9-afc6-31937bc6823a" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:08 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8cf5de99-a676-4dda-adce-4b34e1d8d067 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-bf0a8be2-6039-4bf9-afc6-31937bc6823a" acquired by "delete_volume" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:08 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c42f476-d23c-4172-ba5d-c65c3c1828fe]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:02:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8cf5de99-a676-4dda-adce-4b34e1d8d067 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:08 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a Jul 10 05:02:08 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:09 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8cf5de99-a676-4dda-adce-4b34e1d8d067 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a" returned: 0 in 0.782s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8cf5de99-a676-4dda-adce-4b34e1d8d067 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:09 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a Jul 10 05:02:09 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:10 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8cf5de99-a676-4dda-adce-4b34e1d8d067 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-bf0a8be2-6039-4bf9-afc6-31937bc6823a" returned: 0 in 0.655s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8cf5de99-a676-4dda-adce-4b34e1d8d067 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-bf0a8be2-6039-4bf9-afc6-31937bc6823a" released by "delete_volume" :: held 1.500s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:10 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-8cf5de99-a676-4dda-adce-4b34e1d8d067 tempest-ProjectMemberTests-1536548769 None] Created reservations ['1c77c1cd-c43d-4a2a-9bdf-eae2e31ca0ef', 'fe11741a-1d05-4e65-994b-1265cd1e28f5', '6cefff3b-1068-4cb1-b6dd-e3f17b360d2c', '083e9e68-beb2-4339-b622-70df0bca163f'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:02:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8cf5de99-a676-4dda-adce-4b34e1d8d067 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8cf5de99-a676-4dda-adce-4b34e1d8d067 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8cf5de99-a676-4dda-adce-4b34e1d8d067 tempest-ProjectMemberTests-1536548769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:02:10 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8cf5de99-a676-4dda-adce-4b34e1d8d067 tempest-ProjectMemberTests-1536548769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:02:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8cf5de99-a676-4dda-adce-4b34e1d8d067 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8cf5de99-a676-4dda-adce-4b34e1d8d067 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:10 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:02:10 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:11 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8cf5de99-a676-4dda-adce-4b34e1d8d067 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.677s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-8cf5de99-a676-4dda-adce-4b34e1d8d067 tempest-ProjectMemberTests-1536548769 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:02:11 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-8cf5de99-a676-4dda-adce-4b34e1d8d067 tempest-ProjectMemberTests-1536548769 None] Deleted volume successfully. Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8cf5de99-a676-4dda-adce-4b34e1d8d067 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-bf0a8be2-6039-4bf9-afc6-31937bc6823a-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Flow 'volume_create_manager' (c95fef6c-5861-420f-ab13-5d7e8a119c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7dc261-342c-42ba-8e71-9ba50fb50735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7dc261-342c-42ba-8e71-9ba50fb50735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-886653514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b12ec326-b96c-41f5-b37c-e65ce0454539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4b418f932c4d1f8f37edd3cc0b7dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:02:11Z,use_quota=True,user_id='124e0cf464a84f5ab1b9058b1a0fffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94eee945-fa76-4d2b-b58a-21f033a4cea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94eee945-fa76-4d2b-b58a-21f033a4cea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc26550d-d7d5-4a09-a7cc-3485d163401e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc26550d-d7d5-4a09-a7cc-3485d163401e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b12ec326-b96c-41f5-b37c-e65ce0454539', 'volume_name': 'volume-b12ec326-b96c-41f5-b37c-e65ce0454539', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146d3b68-205d-4ae5-a142-f77d7acb3743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146d3b68-205d-4ae5-a142-f77d7acb3743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bcc0ed9-b907-4cc4-a5a5-1c6704f21f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:11 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Volume b12ec326-b96c-41f5-b37c-e65ce0454539: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b12ec326-b96c-41f5-b37c-e65ce0454539', 'volume_size': 1} Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-886653514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b12ec326-b96c-41f5-b37c-e65ce0454539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4b418f932c4d1f8f37edd3cc0b7dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:02:11Z,use_quota=True,user_id='124e0cf464a84f5ab1b9058b1a0fffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Creating volume b12ec326-b96c-41f5-b37c-e65ce0454539 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:02:11 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:02:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:11 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539 1073741824 Jul 10 05:02:11 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:12 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539 1073741824" returned: 0 in 0.856s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:12 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539 Jul 10 05:02:12 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:13 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539" returned: 0 in 0.684s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:13 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:02:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:13 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bcc0ed9-b907-4cc4-a5a5-1c6704f21f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b12ec326-b96c-41f5-b37c-e65ce0454539', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:13 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1283d515-9424-4918-8e16-5110442b8cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:13 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Volume volume-b12ec326-b96c-41f5-b37c-e65ce0454539 (b12ec326-b96c-41f5-b37c-e65ce0454539): created successfully Jul 10 05:02:13 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1283d515-9424-4918-8e16-5110442b8cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:13 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Flow 'volume_create_manager' (c95fef6c-5861-420f-ab13-5d7e8a119c17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:02:13 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-fc561e51-e0ee-4f43-b071-96f21ceb5920 tempest-ProjectMemberTests-1536548769 None] Created volume successfully. Jul 10 05:02:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-972a9fc2-26c0-469d-ad21-18627fd2c181 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-972a9fc2-26c0-469d-ad21-18627fd2c181 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:13 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-972a9fc2-26c0-469d-ad21-18627fd2c181 tempest-ProjectMemberTests-1536548769 None] Creating offline snapshot 1df9d099-9dec-441b-9090-0813a676a427 of volume b12ec326-b96c-41f5-b37c-e65ce0454539 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:02:13 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5522ab-f86e-4b77-a6c9-20c2f593d689]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:02:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-972a9fc2-26c0-469d-ad21-18627fd2c181 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:13 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539 Jul 10 05:02:13 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:14 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-972a9fc2-26c0-469d-ad21-18627fd2c181 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539" returned: 0 in 0.764s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-972a9fc2-26c0-469d-ad21-18627fd2c181 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.1df9d099-9dec-441b-9090-0813a676a427 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:14 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.1df9d099-9dec-441b-9090-0813a676a427 1G Jul 10 05:02:14 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:15 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-972a9fc2-26c0-469d-ad21-18627fd2c181 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.1df9d099-9dec-441b-9090-0813a676a427 1G" returned: 0 in 0.792s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-972a9fc2-26c0-469d-ad21-18627fd2c181 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b12ec326-b96c-41f5-b37c-e65ce0454539 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.1df9d099-9dec-441b-9090-0813a676a427 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:15 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b12ec326-b96c-41f5-b37c-e65ce0454539 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.1df9d099-9dec-441b-9090-0813a676a427 Jul 10 05:02:15 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:02:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:02:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:02:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:15 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:02:15 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:16 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-972a9fc2-26c0-469d-ad21-18627fd2c181 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b12ec326-b96c-41f5-b37c-e65ce0454539 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.1df9d099-9dec-441b-9090-0813a676a427" returned: 0 in 0.696s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:16 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-972a9fc2-26c0-469d-ad21-18627fd2c181 tempest-ProjectMemberTests-1536548769 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.1df9d099-9dec-441b-9090-0813a676a427 is being set with open permissions: ugo+rw Jul 10 05:02:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-972a9fc2-26c0-469d-ad21-18627fd2c181 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.1df9d099-9dec-441b-9090-0813a676a427 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:16 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.1df9d099-9dec-441b-9090-0813a676a427 Jul 10 05:02:16 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:16 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.636s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:02:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:02:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 05:02:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 05:02:16 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-972a9fc2-26c0-469d-ad21-18627fd2c181 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.1df9d099-9dec-441b-9090-0813a676a427" returned: 0 in 0.633s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-972a9fc2-26c0-469d-ad21-18627fd2c181 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:16 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.info Jul 10 05:02:16 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:17 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-972a9fc2-26c0-469d-ad21-18627fd2c181 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.info" returned: 0 in 0.658s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:17 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-972a9fc2-26c0-469d-ad21-18627fd2c181 tempest-ProjectMemberTests-1536548769 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.info is being set with open permissions: ugo+rw Jul 10 05:02:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-972a9fc2-26c0-469d-ad21-18627fd2c181 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:17 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.info Jul 10 05:02:17 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:17 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-972a9fc2-26c0-469d-ad21-18627fd2c181 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.info" returned: 0 in 0.668s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-972a9fc2-26c0-469d-ad21-18627fd2c181 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.305s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:18 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-972a9fc2-26c0-469d-ad21-18627fd2c181 tempest-ProjectMemberTests-1536548769 None] Create snapshot completed successfully Jul 10 05:02:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-64885fd2-87a1-47f5-99bd-9fffa1b5e76e tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-1df9d099-9dec-441b-9090-0813a676a427-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-64885fd2-87a1-47f5-99bd-9fffa1b5e76e tempest-ProjectMemberTests-1536548769 None] Lock "cinder-1df9d099-9dec-441b-9090-0813a676a427-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-64885fd2-87a1-47f5-99bd-9fffa1b5e76e tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-b12ec326-b96c-41f5-b37c-e65ce0454539" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-64885fd2-87a1-47f5-99bd-9fffa1b5e76e tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-b12ec326-b96c-41f5-b37c-e65ce0454539" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-64885fd2-87a1-47f5-99bd-9fffa1b5e76e tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-1df9d099-9dec-441b-9090-0813a676a427" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-64885fd2-87a1-47f5-99bd-9fffa1b5e76e tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-1df9d099-9dec-441b-9090-0813a676a427" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:18 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-64885fd2-87a1-47f5-99bd-9fffa1b5e76e tempest-ProjectMemberTests-1536548769 None] Deleting offline snapshot 1df9d099-9dec-441b-9090-0813a676a427 of volume b12ec326-b96c-41f5-b37c-e65ce0454539 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:02:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-64885fd2-87a1-47f5-99bd-9fffa1b5e76e tempest-ProjectMemberTests-1536548769 None] snapshot_file for this snap is: volume-b12ec326-b96c-41f5-b37c-e65ce0454539.1df9d099-9dec-441b-9090-0813a676a427 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:02:19 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aed583f-670c-47fa-bb97-1bb1067f1525]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:02:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-64885fd2-87a1-47f5-99bd-9fffa1b5e76e tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.1df9d099-9dec-441b-9090-0813a676a427 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:19 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.1df9d099-9dec-441b-9090-0813a676a427 Jul 10 05:02:19 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:19 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-64885fd2-87a1-47f5-99bd-9fffa1b5e76e tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.1df9d099-9dec-441b-9090-0813a676a427" returned: 0 in 0.807s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-64885fd2-87a1-47f5-99bd-9fffa1b5e76e tempest-ProjectMemberTests-1536548769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b12ec326-b96c-41f5-b37c-e65ce0454539(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:02:19 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd005c28-33b2-48cc-9b32-7a2c476b03ac]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:02:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-64885fd2-87a1-47f5-99bd-9fffa1b5e76e tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:19 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539 Jul 10 05:02:19 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:20 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-64885fd2-87a1-47f5-99bd-9fffa1b5e76e tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539" returned: 0 in 0.819s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-64885fd2-87a1-47f5-99bd-9fffa1b5e76e tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.1df9d099-9dec-441b-9090-0813a676a427 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:20 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.1df9d099-9dec-441b-9090-0813a676a427 Jul 10 05:02:20 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:21 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-64885fd2-87a1-47f5-99bd-9fffa1b5e76e tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.1df9d099-9dec-441b-9090-0813a676a427" returned: 0 in 0.760s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-64885fd2-87a1-47f5-99bd-9fffa1b5e76e tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.1df9d099-9dec-441b-9090-0813a676a427 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:21 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.1df9d099-9dec-441b-9090-0813a676a427 Jul 10 05:02:21 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:22 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-64885fd2-87a1-47f5-99bd-9fffa1b5e76e tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539.1df9d099-9dec-441b-9090-0813a676a427" returned: 0 in 0.678s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-64885fd2-87a1-47f5-99bd-9fffa1b5e76e tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-1df9d099-9dec-441b-9090-0813a676a427" released by "_delete_snapshot" :: held 3.174s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-64885fd2-87a1-47f5-99bd-9fffa1b5e76e tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-b12ec326-b96c-41f5-b37c-e65ce0454539" released by "delete_snapshot" :: held 3.204s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:22 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-64885fd2-87a1-47f5-99bd-9fffa1b5e76e tempest-ProjectMemberTests-1536548769 None] Created reservations ['cd5dec7d-bb80-4d61-bd57-19c1fc795089', '108c51ef-54de-4de2-af42-0541a6fbc6c5', '3f54e292-1e1c-47a2-be04-989f6e05ce53', '1fa14805-f494-4e8d-8038-0470b0ff00da'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:02:22 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-64885fd2-87a1-47f5-99bd-9fffa1b5e76e tempest-ProjectMemberTests-1536548769 None] Delete snapshot completed successfully. Jul 10 05:02:22 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-64885fd2-87a1-47f5-99bd-9fffa1b5e76e tempest-ProjectMemberTests-1536548769 None] Lock "cinder-1df9d099-9dec-441b-9090-0813a676a427-delete_snapshot" released by "delete_snapshot" :: held 3.354s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:23 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8cdb0283-9818-4567-b772-0365f4703e23 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-b12ec326-b96c-41f5-b37c-e65ce0454539-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:23 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8cdb0283-9818-4567-b772-0365f4703e23 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-b12ec326-b96c-41f5-b37c-e65ce0454539-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:23 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8cdb0283-9818-4567-b772-0365f4703e23 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-b12ec326-b96c-41f5-b37c-e65ce0454539" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:23 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8cdb0283-9818-4567-b772-0365f4703e23 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-b12ec326-b96c-41f5-b37c-e65ce0454539" acquired by "delete_volume" :: waited 0.021s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:23 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[368e6e57-caf8-41ab-85a9-6ba3f2bf7577]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:02:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8cdb0283-9818-4567-b772-0365f4703e23 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:23 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539 Jul 10 05:02:23 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:24 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8cdb0283-9818-4567-b772-0365f4703e23 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539" returned: 0 in 0.809s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8cdb0283-9818-4567-b772-0365f4703e23 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:24 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539 Jul 10 05:02:24 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:24 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8cdb0283-9818-4567-b772-0365f4703e23 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-b12ec326-b96c-41f5-b37c-e65ce0454539" returned: 0 in 0.663s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:24 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8cdb0283-9818-4567-b772-0365f4703e23 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-b12ec326-b96c-41f5-b37c-e65ce0454539" released by "delete_volume" :: held 1.535s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:24 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-8cdb0283-9818-4567-b772-0365f4703e23 tempest-ProjectMemberTests-1536548769 None] Created reservations ['119a973e-22dd-4258-9f55-75a38387f85c', '6729c3f4-7738-423b-888c-c557e698940a', '255729ad-2c4f-46b2-b0e8-68cc059ef9a7', 'bd08ad13-f749-4451-b383-01476d6b423c'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:02:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8cdb0283-9818-4567-b772-0365f4703e23 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8cdb0283-9818-4567-b772-0365f4703e23 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8cdb0283-9818-4567-b772-0365f4703e23 tempest-ProjectMemberTests-1536548769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:02:24 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-8cdb0283-9818-4567-b772-0365f4703e23 tempest-ProjectMemberTests-1536548769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:02:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8cdb0283-9818-4567-b772-0365f4703e23 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8cdb0283-9818-4567-b772-0365f4703e23 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:24 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:02:24 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:25 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8cdb0283-9818-4567-b772-0365f4703e23 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.663s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:25 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-8cdb0283-9818-4567-b772-0365f4703e23 tempest-ProjectMemberTests-1536548769 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:02:25 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-8cdb0283-9818-4567-b772-0365f4703e23 tempest-ProjectMemberTests-1536548769 None] Deleted volume successfully. Jul 10 05:02:25 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-8cdb0283-9818-4567-b772-0365f4703e23 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-b12ec326-b96c-41f5-b37c-e65ce0454539-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:25 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:02:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Flow 'volume_create_manager' (a931de14-ed71-4d45-bc63-f206c01c8baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:02:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e092451b-8ac1-4be8-a97f-4039efa4080d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e092451b-8ac1-4be8-a97f-4039efa4080d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2022125874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cdbb1eb-1d81-4c38-bd72-78fa6509877b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4b418f932c4d1f8f37edd3cc0b7dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:02:26Z,use_quota=True,user_id='124e0cf464a84f5ab1b9058b1a0fffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (919ead51-7956-46e6-bb58-d3586a3b3e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (919ead51-7956-46e6-bb58-d3586a3b3e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2689607c-fe84-43b0-801d-4b294e7705d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2689607c-fe84-43b0-801d-4b294e7705d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cdbb1eb-1d81-4c38-bd72-78fa6509877b', 'volume_name': 'volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:25 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4d1aca-ac07-4312-b294-f89fd7945174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4d1aca-ac07-4312-b294-f89fd7945174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:26 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d044cd6-79da-47aa-a285-89dd4c71ce12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:26 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Volume 5cdbb1eb-1d81-4c38-bd72-78fa6509877b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b', 'volume_size': 1} Jul 10 05:02:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2022125874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cdbb1eb-1d81-4c38-bd72-78fa6509877b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4b418f932c4d1f8f37edd3cc0b7dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:02:26Z,use_quota=True,user_id='124e0cf464a84f5ab1b9058b1a0fffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:02:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Creating volume 5cdbb1eb-1d81-4c38-bd72-78fa6509877b {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:02:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:02:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:02:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:26 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:02:26 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:02:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:26 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b 1073741824 Jul 10 05:02:26 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:26 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b 1073741824" returned: 0 in 0.910s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:26 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b Jul 10 05:02:26 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:27 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b" returned: 0 in 0.671s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:27 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:02:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d044cd6-79da-47aa-a285-89dd4c71ce12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (067c4303-ac99-4631-8cf3-82c666e81242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:27 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Volume volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b (5cdbb1eb-1d81-4c38-bd72-78fa6509877b): created successfully Jul 10 05:02:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (067c4303-ac99-4631-8cf3-82c666e81242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:27 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Flow 'volume_create_manager' (a931de14-ed71-4d45-bc63-f206c01c8baf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:02:27 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-040f1930-0651-477f-b871-df8e21815f17 tempest-ProjectMemberTests-1536548769 None] Created volume successfully. Jul 10 05:02:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c0c07c1a-d623-47a5-96cb-2d84824c3f88 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c0c07c1a-d623-47a5-96cb-2d84824c3f88 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-c0c07c1a-d623-47a5-96cb-2d84824c3f88 tempest-ProjectMemberTests-1536548769 None] Creating offline snapshot eb313630-61ce-4b36-af52-4afb0b0addc8 of volume 5cdbb1eb-1d81-4c38-bd72-78fa6509877b {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:02:28 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5038e3a-f9d6-4c05-bde7-04654a4f2e60]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:02:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0c07c1a-d623-47a5-96cb-2d84824c3f88 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:28 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b Jul 10 05:02:28 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:29 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0c07c1a-d623-47a5-96cb-2d84824c3f88 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b" returned: 0 in 0.829s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0c07c1a-d623-47a5-96cb-2d84824c3f88 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.eb313630-61ce-4b36-af52-4afb0b0addc8 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:29 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.eb313630-61ce-4b36-af52-4afb0b0addc8 1G Jul 10 05:02:29 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:29 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0c07c1a-d623-47a5-96cb-2d84824c3f88 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.eb313630-61ce-4b36-af52-4afb0b0addc8 1G" returned: 0 in 0.825s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0c07c1a-d623-47a5-96cb-2d84824c3f88 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.eb313630-61ce-4b36-af52-4afb0b0addc8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:29 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.eb313630-61ce-4b36-af52-4afb0b0addc8 Jul 10 05:02:29 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:30 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0c07c1a-d623-47a5-96cb-2d84824c3f88 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.eb313630-61ce-4b36-af52-4afb0b0addc8" returned: 0 in 0.718s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:30 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-c0c07c1a-d623-47a5-96cb-2d84824c3f88 tempest-ProjectMemberTests-1536548769 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.eb313630-61ce-4b36-af52-4afb0b0addc8 is being set with open permissions: ugo+rw Jul 10 05:02:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0c07c1a-d623-47a5-96cb-2d84824c3f88 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.eb313630-61ce-4b36-af52-4afb0b0addc8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:30 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.eb313630-61ce-4b36-af52-4afb0b0addc8 Jul 10 05:02:30 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:31 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:02:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Flow 'volume_create_manager' (ec026530-b909-4422-9aac-bbbd1b5da5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:02:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591e3e21-52ab-4ea8-9454-e7d96a7ff2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591e3e21-52ab-4ea8-9454-e7d96a7ff2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:02:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2026807367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba2b1079-0c2d-420e-927b-121675cd4939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bca9c7b618343d9871f98cd71baebe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:02:31Z,use_quota=True,user_id='13d61d95264649668a5df572f2d8d376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e4155f3-a112-42fb-a24c-81bfd176e290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e4155f3-a112-42fb-a24c-81bfd176e290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4159e8c2-9c08-4c88-b47c-75e069b0905c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4159e8c2-9c08-4c88-b47c-75e069b0905c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba2b1079-0c2d-420e-927b-121675cd4939', 'volume_name': 'volume-ba2b1079-0c2d-420e-927b-121675cd4939', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ad9ef4-f64c-4e34-bb8d-1ac63fee7ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ad9ef4-f64c-4e34-bb8d-1ac63fee7ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:31 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a176ac6-d8fd-4029-90cc-61c96e2349bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:31 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Volume ba2b1079-0c2d-420e-927b-121675cd4939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba2b1079-0c2d-420e-927b-121675cd4939', 'volume_size': 1} Jul 10 05:02:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:31 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0c07c1a-d623-47a5-96cb-2d84824c3f88 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.eb313630-61ce-4b36-af52-4afb0b0addc8" returned: 0 in 0.642s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0c07c1a-d623-47a5-96cb-2d84824c3f88 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:31 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.info Jul 10 05:02:31 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:31 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0c07c1a-d623-47a5-96cb-2d84824c3f88 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.info" returned: 0 in 0.648s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:31 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-c0c07c1a-d623-47a5-96cb-2d84824c3f88 tempest-ProjectMemberTests-1536548769 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.info is being set with open permissions: ugo+rw Jul 10 05:02:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0c07c1a-d623-47a5-96cb-2d84824c3f88 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:31 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.info Jul 10 05:02:31 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:32 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-c0c07c1a-d623-47a5-96cb-2d84824c3f88 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.info" returned: 0 in 0.623s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-c0c07c1a-d623-47a5-96cb-2d84824c3f88 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.357s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.371s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:02:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2026807367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba2b1079-0c2d-420e-927b-121675cd4939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bca9c7b618343d9871f98cd71baebe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:02:31Z,use_quota=True,user_id='13d61d95264649668a5df572f2d8d376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:02:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Creating volume ba2b1079-0c2d-420e-927b-121675cd4939 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:02:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:02:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:02:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:32 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:02:32 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:02:32 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ba2b1079-0c2d-420e-927b-121675cd4939 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:32 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ba2b1079-0c2d-420e-927b-121675cd4939 1073741824 Jul 10 05:02:32 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:32 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-c0c07c1a-d623-47a5-96cb-2d84824c3f88 tempest-ProjectMemberTests-1536548769 None] Create snapshot completed successfully Jul 10 05:02:33 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ba2b1079-0c2d-420e-927b-121675cd4939 1073741824" returned: 0 in 0.820s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ba2b1079-0c2d-420e-927b-121675cd4939 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f2722eb2-e2fd-45fe-ab21-040b3603f7b6 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-eb313630-61ce-4b36-af52-4afb0b0addc8-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:33 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ba2b1079-0c2d-420e-927b-121675cd4939 Jul 10 05:02:33 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f2722eb2-e2fd-45fe-ab21-040b3603f7b6 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-eb313630-61ce-4b36-af52-4afb0b0addc8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f2722eb2-e2fd-45fe-ab21-040b3603f7b6 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-5cdbb1eb-1d81-4c38-bd72-78fa6509877b" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f2722eb2-e2fd-45fe-ab21-040b3603f7b6 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-5cdbb1eb-1d81-4c38-bd72-78fa6509877b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f2722eb2-e2fd-45fe-ab21-040b3603f7b6 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-eb313630-61ce-4b36-af52-4afb0b0addc8" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f2722eb2-e2fd-45fe-ab21-040b3603f7b6 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-eb313630-61ce-4b36-af52-4afb0b0addc8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-f2722eb2-e2fd-45fe-ab21-040b3603f7b6 tempest-ProjectMemberTests-1536548769 None] Deleting offline snapshot eb313630-61ce-4b36-af52-4afb0b0addc8 of volume 5cdbb1eb-1d81-4c38-bd72-78fa6509877b {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:02:33 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-f2722eb2-e2fd-45fe-ab21-040b3603f7b6 tempest-ProjectMemberTests-1536548769 None] snapshot_file for this snap is: volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.eb313630-61ce-4b36-af52-4afb0b0addc8 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:02:33 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1867919-308e-4c21-b688-fa9dc006434e]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:02:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f2722eb2-e2fd-45fe-ab21-040b3603f7b6 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.eb313630-61ce-4b36-af52-4afb0b0addc8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:33 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.eb313630-61ce-4b36-af52-4afb0b0addc8 Jul 10 05:02:33 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:34 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ba2b1079-0c2d-420e-927b-121675cd4939" returned: 0 in 0.665s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:02:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a176ac6-d8fd-4029-90cc-61c96e2349bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba2b1079-0c2d-420e-927b-121675cd4939', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfe8ac4-fbc6-416a-9ee3-8e40a84b6517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:34 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Volume volume-ba2b1079-0c2d-420e-927b-121675cd4939 (ba2b1079-0c2d-420e-927b-121675cd4939): created successfully Jul 10 05:02:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfe8ac4-fbc6-416a-9ee3-8e40a84b6517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:34 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Flow 'volume_create_manager' (ec026530-b909-4422-9aac-bbbd1b5da5f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:02:34 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-f68f4dc3-43bc-4848-b061-150ccc35a768 tempest-ProjectReaderTests-83822865 None] Created volume successfully. Jul 10 05:02:34 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f2722eb2-e2fd-45fe-ab21-040b3603f7b6 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.eb313630-61ce-4b36-af52-4afb0b0addc8" returned: 0 in 0.770s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-f2722eb2-e2fd-45fe-ab21-040b3603f7b6 tempest-ProjectMemberTests-1536548769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:02:34 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f7ab26-c1af-44fe-b9fa-100d041bc258]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:02:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f2722eb2-e2fd-45fe-ab21-040b3603f7b6 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:34 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b Jul 10 05:02:34 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:35 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f2722eb2-e2fd-45fe-ab21-040b3603f7b6 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b" returned: 0 in 0.739s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f2722eb2-e2fd-45fe-ab21-040b3603f7b6 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.eb313630-61ce-4b36-af52-4afb0b0addc8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:35 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.eb313630-61ce-4b36-af52-4afb0b0addc8 Jul 10 05:02:35 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f00917f5-627a-471f-be97-bb05313654da tempest-ProjectReaderTests-83822865 None] Acquiring lock "cinder-ba2b1079-0c2d-420e-927b-121675cd4939-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f00917f5-627a-471f-be97-bb05313654da tempest-ProjectReaderTests-83822865 None] Lock "cinder-ba2b1079-0c2d-420e-927b-121675cd4939-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f00917f5-627a-471f-be97-bb05313654da tempest-ProjectReaderTests-83822865 None] Acquiring lock "cinder-quobyte-ba2b1079-0c2d-420e-927b-121675cd4939" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f00917f5-627a-471f-be97-bb05313654da tempest-ProjectReaderTests-83822865 None] Lock "cinder-quobyte-ba2b1079-0c2d-420e-927b-121675cd4939" acquired by "delete_volume" :: waited 0.027s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:35 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d2a2b8-161c-4cae-9737-5e0291a4f7a3]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:02:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f00917f5-627a-471f-be97-bb05313654da tempest-ProjectReaderTests-83822865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ba2b1079-0c2d-420e-927b-121675cd4939 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:35 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ba2b1079-0c2d-420e-927b-121675cd4939 Jul 10 05:02:35 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:35 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f2722eb2-e2fd-45fe-ab21-040b3603f7b6 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.eb313630-61ce-4b36-af52-4afb0b0addc8" returned: 0 in 0.741s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f2722eb2-e2fd-45fe-ab21-040b3603f7b6 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.eb313630-61ce-4b36-af52-4afb0b0addc8 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:35 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.eb313630-61ce-4b36-af52-4afb0b0addc8 Jul 10 05:02:35 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:36 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f00917f5-627a-471f-be97-bb05313654da tempest-ProjectReaderTests-83822865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ba2b1079-0c2d-420e-927b-121675cd4939" returned: 0 in 0.776s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f00917f5-627a-471f-be97-bb05313654da tempest-ProjectReaderTests-83822865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ba2b1079-0c2d-420e-927b-121675cd4939 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:36 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ba2b1079-0c2d-420e-927b-121675cd4939 Jul 10 05:02:36 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:36 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f2722eb2-e2fd-45fe-ab21-040b3603f7b6 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b.eb313630-61ce-4b36-af52-4afb0b0addc8" returned: 0 in 0.650s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f2722eb2-e2fd-45fe-ab21-040b3603f7b6 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-eb313630-61ce-4b36-af52-4afb0b0addc8" released by "_delete_snapshot" :: held 2.988s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f2722eb2-e2fd-45fe-ab21-040b3603f7b6 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-5cdbb1eb-1d81-4c38-bd72-78fa6509877b" released by "delete_snapshot" :: held 3.011s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:36 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-f2722eb2-e2fd-45fe-ab21-040b3603f7b6 tempest-ProjectMemberTests-1536548769 None] Created reservations ['840a5cfb-4f4a-46c8-9fac-b2dbcd5ad093', 'b7c6e192-bb2a-4814-8868-8bdad90b48d9', 'cdbb4c3b-4c71-4fb8-acbb-15720549a678', '18f926b6-4586-4f30-ab69-215a1c4db2b9'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:02:36 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-f2722eb2-e2fd-45fe-ab21-040b3603f7b6 tempest-ProjectMemberTests-1536548769 None] Delete snapshot completed successfully. Jul 10 05:02:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f2722eb2-e2fd-45fe-ab21-040b3603f7b6 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-eb313630-61ce-4b36-af52-4afb0b0addc8-delete_snapshot" released by "delete_snapshot" :: held 3.174s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:36 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:36 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f00917f5-627a-471f-be97-bb05313654da tempest-ProjectReaderTests-83822865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ba2b1079-0c2d-420e-927b-121675cd4939" returned: 0 in 0.688s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:36 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f00917f5-627a-471f-be97-bb05313654da tempest-ProjectReaderTests-83822865 None] Lock "cinder-quobyte-ba2b1079-0c2d-420e-927b-121675cd4939" released by "delete_volume" :: held 1.501s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:37 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-f00917f5-627a-471f-be97-bb05313654da tempest-ProjectReaderTests-83822865 None] Created reservations ['f56e9d0e-4423-4ca0-9709-db53cff7d43d', '799478d7-27af-4244-85c7-f66d48d2842e', 'c04bae73-f9ed-47c1-b451-64825a33cc2b', 'e85470cb-d191-46d8-bb93-5279f64d073b'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:02:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f00917f5-627a-471f-be97-bb05313654da tempest-ProjectReaderTests-83822865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f00917f5-627a-471f-be97-bb05313654da tempest-ProjectReaderTests-83822865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f00917f5-627a-471f-be97-bb05313654da tempest-ProjectReaderTests-83822865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:02:37 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f00917f5-627a-471f-be97-bb05313654da tempest-ProjectReaderTests-83822865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:02:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f00917f5-627a-471f-be97-bb05313654da tempest-ProjectReaderTests-83822865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f00917f5-627a-471f-be97-bb05313654da tempest-ProjectReaderTests-83822865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:37 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:02:37 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-617ca289-cda3-4a1c-9d1d-3a25bfcf32ff tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-5cdbb1eb-1d81-4c38-bd72-78fa6509877b-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-617ca289-cda3-4a1c-9d1d-3a25bfcf32ff tempest-ProjectMemberTests-1536548769 None] Lock "cinder-5cdbb1eb-1d81-4c38-bd72-78fa6509877b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-617ca289-cda3-4a1c-9d1d-3a25bfcf32ff tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-5cdbb1eb-1d81-4c38-bd72-78fa6509877b" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-617ca289-cda3-4a1c-9d1d-3a25bfcf32ff tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-5cdbb1eb-1d81-4c38-bd72-78fa6509877b" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:37 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1acb62-5233-46bd-af05-2d0848d0446e]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:02:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-617ca289-cda3-4a1c-9d1d-3a25bfcf32ff tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:37 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:37 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f00917f5-627a-471f-be97-bb05313654da tempest-ProjectReaderTests-83822865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.684s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:37 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-f00917f5-627a-471f-be97-bb05313654da tempest-ProjectReaderTests-83822865 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:02:37 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-f00917f5-627a-471f-be97-bb05313654da tempest-ProjectReaderTests-83822865 None] Deleted volume successfully. Jul 10 05:02:37 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-f00917f5-627a-471f-be97-bb05313654da tempest-ProjectReaderTests-83822865 None] Lock "cinder-ba2b1079-0c2d-420e-927b-121675cd4939-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:37 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b Jul 10 05:02:37 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Flow 'volume_create_manager' (57618de3-7d48-4f51-8f9e-2b2c9fa27f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f3372f-0a55-477f-ba7e-0812f66a71c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f3372f-0a55-477f-ba7e-0812f66a71c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-203505769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ca669f-cfa9-4f16-8fe1-509c291618bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bca9c7b618343d9871f98cd71baebe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:02:38Z,use_quota=True,user_id='13d61d95264649668a5df572f2d8d376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4609c53b-2f13-4b98-ac34-31caa24c44b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4609c53b-2f13-4b98-ac34-31caa24c44b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f777b2-17a0-4a3e-8de2-ff6a024b2639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f777b2-17a0-4a3e-8de2-ff6a024b2639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64ca669f-cfa9-4f16-8fe1-509c291618bf', 'volume_name': 'volume-64ca669f-cfa9-4f16-8fe1-509c291618bf', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ee2ab2-3005-407a-8171-b19fafcdd3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ee2ab2-3005-407a-8171-b19fafcdd3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de239a1b-cc01-4bd4-8c49-152f0faabb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:38 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Volume 64ca669f-cfa9-4f16-8fe1-509c291618bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64ca669f-cfa9-4f16-8fe1-509c291618bf', 'volume_size': 1} Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-203505769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ca669f-cfa9-4f16-8fe1-509c291618bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bca9c7b618343d9871f98cd71baebe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:02:38Z,use_quota=True,user_id='13d61d95264649668a5df572f2d8d376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Creating volume 64ca669f-cfa9-4f16-8fe1-509c291618bf {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:02:38 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-64ca669f-cfa9-4f16-8fe1-509c291618bf 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:38 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-64ca669f-cfa9-4f16-8fe1-509c291618bf 1073741824 Jul 10 05:02:38 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:38 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-617ca289-cda3-4a1c-9d1d-3a25bfcf32ff tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b" returned: 0 in 0.789s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:38 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-617ca289-cda3-4a1c-9d1d-3a25bfcf32ff tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:38 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b Jul 10 05:02:38 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:39 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-64ca669f-cfa9-4f16-8fe1-509c291618bf 1073741824" returned: 0 in 0.851s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-64ca669f-cfa9-4f16-8fe1-509c291618bf {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:39 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-64ca669f-cfa9-4f16-8fe1-509c291618bf Jul 10 05:02:39 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:39 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-617ca289-cda3-4a1c-9d1d-3a25bfcf32ff tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-5cdbb1eb-1d81-4c38-bd72-78fa6509877b" returned: 0 in 0.720s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:39 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-617ca289-cda3-4a1c-9d1d-3a25bfcf32ff tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-5cdbb1eb-1d81-4c38-bd72-78fa6509877b" released by "delete_volume" :: held 1.575s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:39 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-617ca289-cda3-4a1c-9d1d-3a25bfcf32ff tempest-ProjectMemberTests-1536548769 None] Created reservations ['7009cb92-78ef-4435-be74-06296013d070', '21fd417a-f900-4f2d-8f84-787b3082e0c7', '4d8d6ec9-fdd8-456e-94d9-76f14ee03723', '72a598c7-adfb-448f-a390-1d7778fc26bc'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:02:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-617ca289-cda3-4a1c-9d1d-3a25bfcf32ff tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-617ca289-cda3-4a1c-9d1d-3a25bfcf32ff tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-617ca289-cda3-4a1c-9d1d-3a25bfcf32ff tempest-ProjectMemberTests-1536548769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:02:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-617ca289-cda3-4a1c-9d1d-3a25bfcf32ff tempest-ProjectMemberTests-1536548769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:02:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-617ca289-cda3-4a1c-9d1d-3a25bfcf32ff tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-617ca289-cda3-4a1c-9d1d-3a25bfcf32ff tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:39 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:02:39 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:39 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-64ca669f-cfa9-4f16-8fe1-509c291618bf" returned: 0 in 0.681s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:39 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:02:39 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de239a1b-cc01-4bd4-8c49-152f0faabb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64ca669f-cfa9-4f16-8fe1-509c291618bf', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dbcdc18-1ae2-4d05-b53d-83fc39e793e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:39 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Volume volume-64ca669f-cfa9-4f16-8fe1-509c291618bf (64ca669f-cfa9-4f16-8fe1-509c291618bf): created successfully Jul 10 05:02:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dbcdc18-1ae2-4d05-b53d-83fc39e793e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:39 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Flow 'volume_create_manager' (57618de3-7d48-4f51-8f9e-2b2c9fa27f51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:02:39 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-a5b6f411-9717-4f48-8484-02d9d56bbb00 tempest-ProjectReaderTests-83822865 None] Created volume successfully. Jul 10 05:02:40 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-617ca289-cda3-4a1c-9d1d-3a25bfcf32ff tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.679s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-617ca289-cda3-4a1c-9d1d-3a25bfcf32ff tempest-ProjectMemberTests-1536548769 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:02:40 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-617ca289-cda3-4a1c-9d1d-3a25bfcf32ff tempest-ProjectMemberTests-1536548769 None] Deleted volume successfully. Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-617ca289-cda3-4a1c-9d1d-3a25bfcf32ff tempest-ProjectMemberTests-1536548769 None] Lock "cinder-5cdbb1eb-1d81-4c38-bd72-78fa6509877b-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-dfd203a4-3967-4ce5-8fb7-45c2d0647f7b tempest-ProjectReaderTests-83822865 None] Acquiring lock "cinder-64ca669f-cfa9-4f16-8fe1-509c291618bf-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-dfd203a4-3967-4ce5-8fb7-45c2d0647f7b tempest-ProjectReaderTests-83822865 None] Lock "cinder-64ca669f-cfa9-4f16-8fe1-509c291618bf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=98,cinder:UPDATE=134,cinder:INSERT=35,cinder:DELETE=9 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:INSERT=34,cinder:UPDATE=120,cinder:SELECT=94,cinder:DELETE=12 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-dfd203a4-3967-4ce5-8fb7-45c2d0647f7b tempest-ProjectReaderTests-83822865 None] Acquiring lock "cinder-quobyte-64ca669f-cfa9-4f16-8fe1-509c291618bf" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Flow 'volume_create_manager' (928456c6-edc5-41b2-b23c-b1e55fda1fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406b13ad-d769-4ebe-92e1-dc22d9ff3108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-dfd203a4-3967-4ce5-8fb7-45c2d0647f7b tempest-ProjectReaderTests-83822865 None] Lock "cinder-quobyte-64ca669f-cfa9-4f16-8fe1-509c291618bf" acquired by "delete_volume" :: waited 0.049s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406b13ad-d769-4ebe-92e1-dc22d9ff3108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1530833862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352def3f-2bff-4b1d-a442-fbc2c2811f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4b418f932c4d1f8f37edd3cc0b7dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:02:40Z,use_quota=True,user_id='124e0cf464a84f5ab1b9058b1a0fffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534c2452-a11e-4baf-9381-dc7f613ea77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534c2452-a11e-4baf-9381-dc7f613ea77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96bb1687-2143-4d9f-9133-ceb5b232aded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96bb1687-2143-4d9f-9133-ceb5b232aded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '352def3f-2bff-4b1d-a442-fbc2c2811f99', 'volume_name': 'volume-352def3f-2bff-4b1d-a442-fbc2c2811f99', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73acf10f-9717-4eb8-a61a-92b87d522bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73acf10f-9717-4eb8-a61a-92b87d522bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6771eb91-8702-44a3-a6ce-ed58389d185c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:40 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Volume 352def3f-2bff-4b1d-a442-fbc2c2811f99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-352def3f-2bff-4b1d-a442-fbc2c2811f99', 'volume_size': 1} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1530833862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352def3f-2bff-4b1d-a442-fbc2c2811f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4b418f932c4d1f8f37edd3cc0b7dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:02:40Z,use_quota=True,user_id='124e0cf464a84f5ab1b9058b1a0fffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Creating volume 352def3f-2bff-4b1d-a442-fbc2c2811f99 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:02:40 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7de6467-f903-4bfd-92a8-9ada2bc95b1e]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:02:40 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-dfd203a4-3967-4ce5-8fb7-45c2d0647f7b tempest-ProjectReaderTests-83822865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-64ca669f-cfa9-4f16-8fe1-509c291618bf {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:40 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99 1073741824 Jul 10 05:02:40 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:40 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-64ca669f-cfa9-4f16-8fe1-509c291618bf Jul 10 05:02:40 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:41 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-dfd203a4-3967-4ce5-8fb7-45c2d0647f7b tempest-ProjectReaderTests-83822865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-64ca669f-cfa9-4f16-8fe1-509c291618bf" returned: 0 in 0.791s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-dfd203a4-3967-4ce5-8fb7-45c2d0647f7b tempest-ProjectReaderTests-83822865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-64ca669f-cfa9-4f16-8fe1-509c291618bf {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:41 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-64ca669f-cfa9-4f16-8fe1-509c291618bf Jul 10 05:02:41 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:41 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99 1073741824" returned: 0 in 0.845s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:41 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99 Jul 10 05:02:41 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:41 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:41 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-dfd203a4-3967-4ce5-8fb7-45c2d0647f7b tempest-ProjectReaderTests-83822865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-64ca669f-cfa9-4f16-8fe1-509c291618bf" returned: 0 in 0.649s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:41 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-dfd203a4-3967-4ce5-8fb7-45c2d0647f7b tempest-ProjectReaderTests-83822865 None] Lock "cinder-quobyte-64ca669f-cfa9-4f16-8fe1-509c291618bf" released by "delete_volume" :: held 1.540s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:42 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-dfd203a4-3967-4ce5-8fb7-45c2d0647f7b tempest-ProjectReaderTests-83822865 None] Created reservations ['2faa02d6-e140-42c0-b314-a04bb213efbd', '8f44d7b4-84d0-4057-86a1-9c447c82690c', '007d4d05-3167-4df2-974f-4c07deab361f', '215520e2-3b89-45eb-991b-1f90e3e62166'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:02:42 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99" returned: 0 in 0.649s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:02:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6771eb91-8702-44a3-a6ce-ed58389d185c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-352def3f-2bff-4b1d-a442-fbc2c2811f99', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aac8eec-c673-4043-ac17-611c52ac6d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:42 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Volume volume-352def3f-2bff-4b1d-a442-fbc2c2811f99 (352def3f-2bff-4b1d-a442-fbc2c2811f99): created successfully Jul 10 05:02:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aac8eec-c673-4043-ac17-611c52ac6d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:42 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Flow 'volume_create_manager' (928456c6-edc5-41b2-b23c-b1e55fda1fea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:02:42 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-f3fc6543-184c-48e2-9ced-5067a0feda75 tempest-ProjectMemberTests-1536548769 None] Created volume successfully. Jul 10 05:02:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-dfd203a4-3967-4ce5-8fb7-45c2d0647f7b tempest-ProjectReaderTests-83822865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-dfd203a4-3967-4ce5-8fb7-45c2d0647f7b tempest-ProjectReaderTests-83822865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-dfd203a4-3967-4ce5-8fb7-45c2d0647f7b tempest-ProjectReaderTests-83822865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:02:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-dfd203a4-3967-4ce5-8fb7-45c2d0647f7b tempest-ProjectReaderTests-83822865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:02:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-dfd203a4-3967-4ce5-8fb7-45c2d0647f7b tempest-ProjectReaderTests-83822865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-dfd203a4-3967-4ce5-8fb7-45c2d0647f7b tempest-ProjectReaderTests-83822865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:42 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:02:42 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8630ce04-0f32-4e9d-bae2-d3c02a73d7d4 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8630ce04-0f32-4e9d-bae2-d3c02a73d7d4 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:42 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-8630ce04-0f32-4e9d-bae2-d3c02a73d7d4 tempest-ProjectMemberTests-1536548769 None] Creating offline snapshot 9e199884-c437-4b89-9a34-3bc9f958611b of volume 352def3f-2bff-4b1d-a442-fbc2c2811f99 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:02:42 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae36f1a-d407-43a1-88dd-574c02f783c1]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:02:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8630ce04-0f32-4e9d-bae2-d3c02a73d7d4 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:42 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:42 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-dfd203a4-3967-4ce5-8fb7-45c2d0647f7b tempest-ProjectReaderTests-83822865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.693s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:42 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99 Jul 10 05:02:42 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:42 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-dfd203a4-3967-4ce5-8fb7-45c2d0647f7b tempest-ProjectReaderTests-83822865 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:02:42 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-dfd203a4-3967-4ce5-8fb7-45c2d0647f7b tempest-ProjectReaderTests-83822865 None] Deleted volume successfully. Jul 10 05:02:42 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-dfd203a4-3967-4ce5-8fb7-45c2d0647f7b tempest-ProjectReaderTests-83822865 None] Lock "cinder-64ca669f-cfa9-4f16-8fe1-509c291618bf-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:43 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:02:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Flow 'volume_create_manager' (70d64dae-c995-407d-a5f8-94a2aa870ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:02:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31412d44-1ce2-457c-bac4-e56ccc8721d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31412d44-1ce2-457c-bac4-e56ccc8721d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1875560484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bca9c7b618343d9871f98cd71baebe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:02:43Z,use_quota=True,user_id='13d61d95264649668a5df572f2d8d376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (366e8ce0-6181-430f-bab2-fc57810811ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (366e8ce0-6181-430f-bab2-fc57810811ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6551e10-2564-48be-aa3c-37e2b6131f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6551e10-2564-48be-aa3c-37e2b6131f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589', 'volume_name': 'volume-de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a5af9f-5828-4c75-bbd7-9d74f5fe9688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a5af9f-5828-4c75-bbd7-9d74f5fe9688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:43 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c48bb6-d7d4-4d31-8155-5ebbad3b20e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:43 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Volume de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589', 'volume_size': 1} Jul 10 05:02:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:43 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8630ce04-0f32-4e9d-bae2-d3c02a73d7d4 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99" returned: 0 in 0.783s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:43 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8630ce04-0f32-4e9d-bae2-d3c02a73d7d4 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.9e199884-c437-4b89-9a34-3bc9f958611b 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:43 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.9e199884-c437-4b89-9a34-3bc9f958611b 1G Jul 10 05:02:43 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:44 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8630ce04-0f32-4e9d-bae2-d3c02a73d7d4 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.9e199884-c437-4b89-9a34-3bc9f958611b 1G" returned: 0 in 0.784s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8630ce04-0f32-4e9d-bae2-d3c02a73d7d4 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-352def3f-2bff-4b1d-a442-fbc2c2811f99 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.9e199884-c437-4b89-9a34-3bc9f958611b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:44 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-352def3f-2bff-4b1d-a442-fbc2c2811f99 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.9e199884-c437-4b89-9a34-3bc9f958611b Jul 10 05:02:44 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:44 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8630ce04-0f32-4e9d-bae2-d3c02a73d7d4 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-352def3f-2bff-4b1d-a442-fbc2c2811f99 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.9e199884-c437-4b89-9a34-3bc9f958611b" returned: 0 in 0.688s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:44 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-8630ce04-0f32-4e9d-bae2-d3c02a73d7d4 tempest-ProjectMemberTests-1536548769 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.9e199884-c437-4b89-9a34-3bc9f958611b is being set with open permissions: ugo+rw Jul 10 05:02:44 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8630ce04-0f32-4e9d-bae2-d3c02a73d7d4 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.9e199884-c437-4b89-9a34-3bc9f958611b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:44 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.9e199884-c437-4b89-9a34-3bc9f958611b Jul 10 05:02:44 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:45 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8630ce04-0f32-4e9d-bae2-d3c02a73d7d4 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.9e199884-c437-4b89-9a34-3bc9f958611b" returned: 0 in 0.643s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:45 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8630ce04-0f32-4e9d-bae2-d3c02a73d7d4 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:45 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.info Jul 10 05:02:45 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:46 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8630ce04-0f32-4e9d-bae2-d3c02a73d7d4 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.info" returned: 0 in 0.641s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:46 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-8630ce04-0f32-4e9d-bae2-d3c02a73d7d4 tempest-ProjectMemberTests-1536548769 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.info is being set with open permissions: ugo+rw Jul 10 05:02:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8630ce04-0f32-4e9d-bae2-d3c02a73d7d4 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:46 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.info Jul 10 05:02:46 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:46 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-8630ce04-0f32-4e9d-bae2-d3c02a73d7d4 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.info" returned: 0 in 0.634s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-8630ce04-0f32-4e9d-bae2-d3c02a73d7d4 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.267s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.817s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1875560484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bca9c7b618343d9871f98cd71baebe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:02:43Z,use_quota=True,user_id='13d61d95264649668a5df572f2d8d376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:02:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Creating volume de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:02:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:02:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:02:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:46 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:02:46 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:02:46 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:46 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589 1073741824 Jul 10 05:02:46 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:46 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-8630ce04-0f32-4e9d-bae2-d3c02a73d7d4 tempest-ProjectMemberTests-1536548769 None] Create snapshot completed successfully Jul 10 05:02:47 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589 1073741824" returned: 0 in 0.804s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:47 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589 Jul 10 05:02:47 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0ea86ba9-230d-4525-8da9-406c959aa4d4 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-9e199884-c437-4b89-9a34-3bc9f958611b-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0ea86ba9-230d-4525-8da9-406c959aa4d4 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-9e199884-c437-4b89-9a34-3bc9f958611b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0ea86ba9-230d-4525-8da9-406c959aa4d4 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-352def3f-2bff-4b1d-a442-fbc2c2811f99" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0ea86ba9-230d-4525-8da9-406c959aa4d4 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-352def3f-2bff-4b1d-a442-fbc2c2811f99" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0ea86ba9-230d-4525-8da9-406c959aa4d4 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-9e199884-c437-4b89-9a34-3bc9f958611b" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:47 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0ea86ba9-230d-4525-8da9-406c959aa4d4 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-9e199884-c437-4b89-9a34-3bc9f958611b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-0ea86ba9-230d-4525-8da9-406c959aa4d4 tempest-ProjectMemberTests-1536548769 None] Deleting offline snapshot 9e199884-c437-4b89-9a34-3bc9f958611b of volume 352def3f-2bff-4b1d-a442-fbc2c2811f99 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:02:47 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-0ea86ba9-230d-4525-8da9-406c959aa4d4 tempest-ProjectMemberTests-1536548769 None] snapshot_file for this snap is: volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.9e199884-c437-4b89-9a34-3bc9f958611b {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:02:47 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4154ba-b468-41ee-a5af-cc68296961f9]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:02:47 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0ea86ba9-230d-4525-8da9-406c959aa4d4 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.9e199884-c437-4b89-9a34-3bc9f958611b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:48 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.9e199884-c437-4b89-9a34-3bc9f958611b Jul 10 05:02:48 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:48 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589" returned: 0 in 0.629s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:02:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c48bb6-d7d4-4d31-8155-5ebbad3b20e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609abe23-5cb8-48c0-bbe9-a0647ce73773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:48 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Volume volume-de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589 (de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589): created successfully Jul 10 05:02:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609abe23-5cb8-48c0-bbe9-a0647ce73773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:48 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Flow 'volume_create_manager' (70d64dae-c995-407d-a5f8-94a2aa870ca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:02:48 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d7694a0e-4cbc-407d-a6b3-81a7fe15c27a tempest-ProjectReaderTests-83822865 None] Created volume successfully. Jul 10 05:02:48 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0ea86ba9-230d-4525-8da9-406c959aa4d4 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.9e199884-c437-4b89-9a34-3bc9f958611b" returned: 0 in 0.751s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:48 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-0ea86ba9-230d-4525-8da9-406c959aa4d4 tempest-ProjectMemberTests-1536548769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-352def3f-2bff-4b1d-a442-fbc2c2811f99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:02:48 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e45e3e4-6571-4fab-aaf5-ff5cb4aaefca]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:02:48 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0ea86ba9-230d-4525-8da9-406c959aa4d4 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:48 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99 Jul 10 05:02:48 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:49 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e37ff5d1-8094-4450-9933-0f170384937a tempest-ProjectReaderTests-83822865 None] Acquiring lock "cinder-de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:49 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e37ff5d1-8094-4450-9933-0f170384937a tempest-ProjectReaderTests-83822865 None] Lock "cinder-de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:49 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0ea86ba9-230d-4525-8da9-406c959aa4d4 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99" returned: 0 in 0.728s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0ea86ba9-230d-4525-8da9-406c959aa4d4 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.9e199884-c437-4b89-9a34-3bc9f958611b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:49 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.9e199884-c437-4b89-9a34-3bc9f958611b Jul 10 05:02:49 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:49 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e37ff5d1-8094-4450-9933-0f170384937a tempest-ProjectReaderTests-83822865 None] Acquiring lock "cinder-quobyte-de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:49 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e37ff5d1-8094-4450-9933-0f170384937a tempest-ProjectReaderTests-83822865 None] Lock "cinder-quobyte-de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589" acquired by "delete_volume" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:49 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cf5b74-7544-4afd-b33f-6478d42efef0]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:02:49 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e37ff5d1-8094-4450-9933-0f170384937a tempest-ProjectReaderTests-83822865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:49 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589 Jul 10 05:02:49 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:50 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0ea86ba9-230d-4525-8da9-406c959aa4d4 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.9e199884-c437-4b89-9a34-3bc9f958611b" returned: 0 in 0.712s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0ea86ba9-230d-4525-8da9-406c959aa4d4 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.9e199884-c437-4b89-9a34-3bc9f958611b {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:50 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.9e199884-c437-4b89-9a34-3bc9f958611b Jul 10 05:02:50 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:50 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e37ff5d1-8094-4450-9933-0f170384937a tempest-ProjectReaderTests-83822865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589" returned: 0 in 0.781s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e37ff5d1-8094-4450-9933-0f170384937a tempest-ProjectReaderTests-83822865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:50 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589 Jul 10 05:02:50 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:50 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0ea86ba9-230d-4525-8da9-406c959aa4d4 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99.9e199884-c437-4b89-9a34-3bc9f958611b" returned: 0 in 0.675s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0ea86ba9-230d-4525-8da9-406c959aa4d4 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-9e199884-c437-4b89-9a34-3bc9f958611b" released by "_delete_snapshot" :: held 2.961s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0ea86ba9-230d-4525-8da9-406c959aa4d4 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-352def3f-2bff-4b1d-a442-fbc2c2811f99" released by "delete_snapshot" :: held 2.981s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:50 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-0ea86ba9-230d-4525-8da9-406c959aa4d4 tempest-ProjectMemberTests-1536548769 None] Created reservations ['0220d7f0-dbbb-4b7e-8c42-022b929b1ce2', 'ee9f9b65-28dd-4250-a5fa-9b249a2506ff', '9141bec7-3ecd-4b2b-ae27-0aa45237fb3e', 'ede12573-9c41-4e52-91f5-b2afafe0176b'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:02:50 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:50 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e37ff5d1-8094-4450-9933-0f170384937a tempest-ProjectReaderTests-83822865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589" returned: 0 in 0.658s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:50 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e37ff5d1-8094-4450-9933-0f170384937a tempest-ProjectReaderTests-83822865 None] Lock "cinder-quobyte-de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589" released by "delete_volume" :: held 1.486s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:50 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-0ea86ba9-230d-4525-8da9-406c959aa4d4 tempest-ProjectMemberTests-1536548769 None] Delete snapshot completed successfully. Jul 10 05:02:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0ea86ba9-230d-4525-8da9-406c959aa4d4 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-9e199884-c437-4b89-9a34-3bc9f958611b-delete_snapshot" released by "delete_snapshot" :: held 3.146s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1fae659a-477b-40b4-84a9-8c108c044920 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-352def3f-2bff-4b1d-a442-fbc2c2811f99-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:51 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-e37ff5d1-8094-4450-9933-0f170384937a tempest-ProjectReaderTests-83822865 None] Created reservations ['96816e90-0643-4d93-8517-567b565d05d9', '40d9c531-c041-4dfb-a6ba-23f2c4da650b', 'fcf0c853-03ad-4a84-97c9-3078e5023437', '46cf133f-95fe-42c0-8708-56097e5f1a9d'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:02:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1fae659a-477b-40b4-84a9-8c108c044920 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-352def3f-2bff-4b1d-a442-fbc2c2811f99-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1fae659a-477b-40b4-84a9-8c108c044920 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-352def3f-2bff-4b1d-a442-fbc2c2811f99" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1fae659a-477b-40b4-84a9-8c108c044920 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-352def3f-2bff-4b1d-a442-fbc2c2811f99" acquired by "delete_volume" :: waited 0.019s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:51 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3ea477-071c-4228-8f4c-f3233d82efd5]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:02:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1fae659a-477b-40b4-84a9-8c108c044920 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e37ff5d1-8094-4450-9933-0f170384937a tempest-ProjectReaderTests-83822865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e37ff5d1-8094-4450-9933-0f170384937a tempest-ProjectReaderTests-83822865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:51 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e37ff5d1-8094-4450-9933-0f170384937a tempest-ProjectReaderTests-83822865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:02:51 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-e37ff5d1-8094-4450-9933-0f170384937a tempest-ProjectReaderTests-83822865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:02:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-e37ff5d1-8094-4450-9933-0f170384937a tempest-ProjectReaderTests-83822865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e37ff5d1-8094-4450-9933-0f170384937a tempest-ProjectReaderTests-83822865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:51 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:02:51 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:51 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99 Jul 10 05:02:51 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:51 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-e37ff5d1-8094-4450-9933-0f170384937a tempest-ProjectReaderTests-83822865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.696s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:51 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-e37ff5d1-8094-4450-9933-0f170384937a tempest-ProjectReaderTests-83822865 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:02:51 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-e37ff5d1-8094-4450-9933-0f170384937a tempest-ProjectReaderTests-83822865 None] Deleted volume successfully. Jul 10 05:02:51 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-e37ff5d1-8094-4450-9933-0f170384937a tempest-ProjectReaderTests-83822865 None] Lock "cinder-de1e6a4c-f85e-4b70-8f2d-6f0e8ff59589-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:51 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1fae659a-477b-40b4-84a9-8c108c044920 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99" returned: 0 in 0.827s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:51 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1fae659a-477b-40b4-84a9-8c108c044920 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:52 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99 Jul 10 05:02:52 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Flow 'volume_create_manager' (9937c8b0-9f69-4ca3-b2b8-c4038444b215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b6e692c-af4f-4248-90d0-cbc8229268ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b6e692c-af4f-4248-90d0-cbc8229268ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1512055074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c2ebc4-0ea1-409d-8e10-dd25dce9175e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bca9c7b618343d9871f98cd71baebe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:02:52Z,use_quota=True,user_id='13d61d95264649668a5df572f2d8d376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ecf8ba9-d57b-4b9b-b7f9-fd02353baeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ecf8ba9-d57b-4b9b-b7f9-fd02353baeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e84772-5c69-4012-bd94-f1cd713fef59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e84772-5c69-4012-bd94-f1cd713fef59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67c2ebc4-0ea1-409d-8e10-dd25dce9175e', 'volume_name': 'volume-67c2ebc4-0ea1-409d-8e10-dd25dce9175e', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7840df7d-6e7b-43d0-837f-c914321126b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7840df7d-6e7b-43d0-837f-c914321126b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f724fef7-d4b4-4771-9b81-f07753e36cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:52 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Volume 67c2ebc4-0ea1-409d-8e10-dd25dce9175e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67c2ebc4-0ea1-409d-8e10-dd25dce9175e', 'volume_size': 1} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1512055074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c2ebc4-0ea1-409d-8e10-dd25dce9175e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bca9c7b618343d9871f98cd71baebe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:02:52Z,use_quota=True,user_id='13d61d95264649668a5df572f2d8d376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Creating volume 67c2ebc4-0ea1-409d-8e10-dd25dce9175e {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:02:52 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-67c2ebc4-0ea1-409d-8e10-dd25dce9175e 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:52 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-67c2ebc4-0ea1-409d-8e10-dd25dce9175e 1073741824 Jul 10 05:02:52 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:52 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1fae659a-477b-40b4-84a9-8c108c044920 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-352def3f-2bff-4b1d-a442-fbc2c2811f99" returned: 0 in 0.692s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1fae659a-477b-40b4-84a9-8c108c044920 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-352def3f-2bff-4b1d-a442-fbc2c2811f99" released by "delete_volume" :: held 1.579s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-1fae659a-477b-40b4-84a9-8c108c044920 tempest-ProjectMemberTests-1536548769 None] Created reservations ['c6656c51-bb26-4673-a6af-0dda75a9a358', 'e2c2246c-6c00-4bc4-9eb9-6b8902aa0f59', 'c81ec154-cd77-4e37-9d67-93ce99449ea5', '34ee35ea-1ba1-43e6-aabf-5be14c15beb7'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1fae659a-477b-40b4-84a9-8c108c044920 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1fae659a-477b-40b4-84a9-8c108c044920 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1fae659a-477b-40b4-84a9-8c108c044920 tempest-ProjectMemberTests-1536548769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1fae659a-477b-40b4-84a9-8c108c044920 tempest-ProjectMemberTests-1536548769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1fae659a-477b-40b4-84a9-8c108c044920 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:52 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1fae659a-477b-40b4-84a9-8c108c044920 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:52 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:02:52 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:53 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-67c2ebc4-0ea1-409d-8e10-dd25dce9175e 1073741824" returned: 0 in 0.854s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-67c2ebc4-0ea1-409d-8e10-dd25dce9175e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:53 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-67c2ebc4-0ea1-409d-8e10-dd25dce9175e Jul 10 05:02:53 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:53 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1fae659a-477b-40b4-84a9-8c108c044920 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.698s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-1fae659a-477b-40b4-84a9-8c108c044920 tempest-ProjectMemberTests-1536548769 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:02:53 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-1fae659a-477b-40b4-84a9-8c108c044920 tempest-ProjectMemberTests-1536548769 None] Deleted volume successfully. Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1fae659a-477b-40b4-84a9-8c108c044920 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-352def3f-2bff-4b1d-a442-fbc2c2811f99-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Flow 'volume_create_manager' (06aea2fa-0c6a-4029-b5a1-d218f9ebdd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a65f06d-38c6-49d7-8396-477ab9b0524d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a65f06d-38c6-49d7-8396-477ab9b0524d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1275856244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d33c2d-769c-4c3d-9baf-5cf39e92ca67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4b418f932c4d1f8f37edd3cc0b7dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:02:54Z,use_quota=True,user_id='124e0cf464a84f5ab1b9058b1a0fffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:53 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6ec88b-026c-4012-b0b5-c5f117dbc248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6ec88b-026c-4012-b0b5-c5f117dbc248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17887bf6-4a43-48e5-b93a-b95d038e8f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17887bf6-4a43-48e5-b93a-b95d038e8f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d33c2d-769c-4c3d-9baf-5cf39e92ca67', 'volume_name': 'volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d7d8e94-59bd-4c23-a4a7-77f3737754ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d7d8e94-59bd-4c23-a4a7-77f3737754ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237790a1-9449-4fe9-96b7-873f2c5a0617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:53 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Volume 55d33c2d-769c-4c3d-9baf-5cf39e92ca67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67', 'volume_size': 1} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-67c2ebc4-0ea1-409d-8e10-dd25dce9175e" returned: 0 in 0.742s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1275856244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d33c2d-769c-4c3d-9baf-5cf39e92ca67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4b418f932c4d1f8f37edd3cc0b7dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:02:54Z,use_quota=True,user_id='124e0cf464a84f5ab1b9058b1a0fffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Creating volume 55d33c2d-769c-4c3d-9baf-5cf39e92ca67 {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:02:53 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:53 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67 1073741824 Jul 10 05:02:53 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f724fef7-d4b4-4771-9b81-f07753e36cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67c2ebc4-0ea1-409d-8e10-dd25dce9175e', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b006c0c-cc9f-439f-98ef-6095b40433c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:53 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Volume volume-67c2ebc4-0ea1-409d-8e10-dd25dce9175e (67c2ebc4-0ea1-409d-8e10-dd25dce9175e): created successfully Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b006c0c-cc9f-439f-98ef-6095b40433c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:53 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Flow 'volume_create_manager' (9937c8b0-9f69-4ca3-b2b8-c4038444b215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:02:53 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-ee2cd820-8d84-470c-b015-9f94b6a951ab tempest-ProjectReaderTests-83822865 None] Created volume successfully. Jul 10 05:02:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cf97765-6534-472a-b1eb-11e6eca64c75 tempest-ProjectReaderTests-83822865 None] Acquiring lock "cinder-67c2ebc4-0ea1-409d-8e10-dd25dce9175e-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cf97765-6534-472a-b1eb-11e6eca64c75 tempest-ProjectReaderTests-83822865 None] Lock "cinder-67c2ebc4-0ea1-409d-8e10-dd25dce9175e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cf97765-6534-472a-b1eb-11e6eca64c75 tempest-ProjectReaderTests-83822865 None] Acquiring lock "cinder-quobyte-67c2ebc4-0ea1-409d-8e10-dd25dce9175e" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:02:54 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cf97765-6534-472a-b1eb-11e6eca64c75 tempest-ProjectReaderTests-83822865 None] Lock "cinder-quobyte-67c2ebc4-0ea1-409d-8e10-dd25dce9175e" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:02:54 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d870e6f-20f4-4cb4-92f7-bc2f7a762c96]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:02:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cf97765-6534-472a-b1eb-11e6eca64c75 tempest-ProjectReaderTests-83822865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-67c2ebc4-0ea1-409d-8e10-dd25dce9175e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:54 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-67c2ebc4-0ea1-409d-8e10-dd25dce9175e Jul 10 05:02:54 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:54 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67 1073741824" returned: 0 in 0.823s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:54 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67 Jul 10 05:02:54 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:55 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cf97765-6534-472a-b1eb-11e6eca64c75 tempest-ProjectReaderTests-83822865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-67c2ebc4-0ea1-409d-8e10-dd25dce9175e" returned: 0 in 0.787s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cf97765-6534-472a-b1eb-11e6eca64c75 tempest-ProjectReaderTests-83822865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-67c2ebc4-0ea1-409d-8e10-dd25dce9175e {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:55 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-67c2ebc4-0ea1-409d-8e10-dd25dce9175e Jul 10 05:02:55 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:55 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67" returned: 0 in 0.676s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237790a1-9449-4fe9-96b7-873f2c5a0617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e07279-4c3e-4afa-ab48-ff3e66c7ccae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:02:55 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Volume volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67 (55d33c2d-769c-4c3d-9baf-5cf39e92ca67): created successfully Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e07279-4c3e-4afa-ab48-ff3e66c7ccae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Flow 'volume_create_manager' (06aea2fa-0c6a-4029-b5a1-d218f9ebdd53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:02:55 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-1b6efd5c-86f6-4689-9daa-89c6c4a3add8 tempest-ProjectMemberTests-1536548769 None] Created volume successfully. Jul 10 05:02:55 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cf97765-6534-472a-b1eb-11e6eca64c75 tempest-ProjectReaderTests-83822865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-67c2ebc4-0ea1-409d-8e10-dd25dce9175e" returned: 0 in 0.678s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cf97765-6534-472a-b1eb-11e6eca64c75 tempest-ProjectReaderTests-83822865 None] Lock "cinder-quobyte-67c2ebc4-0ea1-409d-8e10-dd25dce9175e" released by "delete_volume" :: held 1.509s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-7cf97765-6534-472a-b1eb-11e6eca64c75 tempest-ProjectReaderTests-83822865 None] Created reservations ['214033fa-1d99-4ec7-b434-1f3af88c6715', '59595437-5acb-47ab-8afa-6e8198f2bd7d', 'aae86e4c-f4ec-41ab-be7f-0a200f33b926', 'b5f044df-f177-49e9-802d-21cca2ae0fb2'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7cf97765-6534-472a-b1eb-11e6eca64c75 tempest-ProjectReaderTests-83822865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7cf97765-6534-472a-b1eb-11e6eca64c75 tempest-ProjectReaderTests-83822865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7cf97765-6534-472a-b1eb-11e6eca64c75 tempest-ProjectReaderTests-83822865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-7cf97765-6534-472a-b1eb-11e6eca64c75 tempest-ProjectReaderTests-83822865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-7cf97765-6534-472a-b1eb-11e6eca64c75 tempest-ProjectReaderTests-83822865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cf97765-6534-472a-b1eb-11e6eca64c75 tempest-ProjectReaderTests-83822865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:55 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:02:55 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d1e8f93d-f5a5-47d7-897d-e91818094ef6 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d1e8f93d-f5a5-47d7-897d-e91818094ef6 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d1e8f93d-f5a5-47d7-897d-e91818094ef6 tempest-ProjectMemberTests-1536548769 None] Creating offline snapshot 7758b386-ee13-4213-9d2c-f8a7a3ad648d of volume 55d33c2d-769c-4c3d-9baf-5cf39e92ca67 {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4bfbc5-892c-4969-99be-5465a04130b9]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:02:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1e8f93d-f5a5-47d7-897d-e91818094ef6 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:56 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67 Jul 10 05:02:56 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:56 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7cf97765-6534-472a-b1eb-11e6eca64c75 tempest-ProjectReaderTests-83822865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.703s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:56 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-7cf97765-6534-472a-b1eb-11e6eca64c75 tempest-ProjectReaderTests-83822865 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:02:56 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-7cf97765-6534-472a-b1eb-11e6eca64c75 tempest-ProjectReaderTests-83822865 None] Deleted volume successfully. Jul 10 05:02:56 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7cf97765-6534-472a-b1eb-11e6eca64c75 tempest-ProjectReaderTests-83822865 None] Lock "cinder-67c2ebc4-0ea1-409d-8e10-dd25dce9175e-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:02:56 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1e8f93d-f5a5-47d7-897d-e91818094ef6 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67" returned: 0 in 0.796s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1e8f93d-f5a5-47d7-897d-e91818094ef6 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.7758b386-ee13-4213-9d2c-f8a7a3ad648d 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:56 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.7758b386-ee13-4213-9d2c-f8a7a3ad648d 1G Jul 10 05:02:56 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:57 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1e8f93d-f5a5-47d7-897d-e91818094ef6 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.7758b386-ee13-4213-9d2c-f8a7a3ad648d 1G" returned: 0 in 0.854s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1e8f93d-f5a5-47d7-897d-e91818094ef6 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.7758b386-ee13-4213-9d2c-f8a7a3ad648d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:57 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.7758b386-ee13-4213-9d2c-f8a7a3ad648d Jul 10 05:02:57 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:58 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1e8f93d-f5a5-47d7-897d-e91818094ef6 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67 -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.7758b386-ee13-4213-9d2c-f8a7a3ad648d" returned: 0 in 0.732s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:58 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-d1e8f93d-f5a5-47d7-897d-e91818094ef6 tempest-ProjectMemberTests-1536548769 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.7758b386-ee13-4213-9d2c-f8a7a3ad648d is being set with open permissions: ugo+rw Jul 10 05:02:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1e8f93d-f5a5-47d7-897d-e91818094ef6 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.7758b386-ee13-4213-9d2c-f8a7a3ad648d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:58 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.7758b386-ee13-4213-9d2c-f8a7a3ad648d Jul 10 05:02:58 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:58 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1e8f93d-f5a5-47d7-897d-e91818094ef6 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.7758b386-ee13-4213-9d2c-f8a7a3ad648d" returned: 0 in 0.631s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1e8f93d-f5a5-47d7-897d-e91818094ef6 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:59 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.info Jul 10 05:02:59 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:02:59 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Jul 10 05:02:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1e8f93d-f5a5-47d7-897d-e91818094ef6 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.info" returned: 0 in 0.672s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:02:59 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-d1e8f93d-f5a5-47d7-897d-e91818094ef6 tempest-ProjectMemberTests-1536548769 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.info is being set with open permissions: ugo+rw Jul 10 05:02:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1e8f93d-f5a5-47d7-897d-e91818094ef6 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:02:59 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.info Jul 10 05:02:59 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:00 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d1e8f93d-f5a5-47d7-897d-e91818094ef6 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.info" returned: 0 in 0.640s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-d1e8f93d-f5a5-47d7-897d-e91818094ef6 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.404s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:03:00 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d1e8f93d-f5a5-47d7-897d-e91818094ef6 tempest-ProjectMemberTests-1536548769 None] Create snapshot completed successfully Jul 10 05:03:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7a42aa9b-1b97-47c5-bb5f-d9d9652c35d5 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-7758b386-ee13-4213-9d2c-f8a7a3ad648d-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:03:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7a42aa9b-1b97-47c5-bb5f-d9d9652c35d5 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-7758b386-ee13-4213-9d2c-f8a7a3ad648d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:03:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7a42aa9b-1b97-47c5-bb5f-d9d9652c35d5 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-55d33c2d-769c-4c3d-9baf-5cf39e92ca67" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:03:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7a42aa9b-1b97-47c5-bb5f-d9d9652c35d5 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-55d33c2d-769c-4c3d-9baf-5cf39e92ca67" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:03:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7a42aa9b-1b97-47c5-bb5f-d9d9652c35d5 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-7758b386-ee13-4213-9d2c-f8a7a3ad648d" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:03:01 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7a42aa9b-1b97-47c5-bb5f-d9d9652c35d5 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-7758b386-ee13-4213-9d2c-f8a7a3ad648d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:03:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-7a42aa9b-1b97-47c5-bb5f-d9d9652c35d5 tempest-ProjectMemberTests-1536548769 None] Deleting offline snapshot 7758b386-ee13-4213-9d2c-f8a7a3ad648d of volume 55d33c2d-769c-4c3d-9baf-5cf39e92ca67 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:03:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-7a42aa9b-1b97-47c5-bb5f-d9d9652c35d5 tempest-ProjectMemberTests-1536548769 None] snapshot_file for this snap is: volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.7758b386-ee13-4213-9d2c-f8a7a3ad648d {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:03:01 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a8b99a-59a1-418a-ae94-fa52085b240d]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:03:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7a42aa9b-1b97-47c5-bb5f-d9d9652c35d5 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.7758b386-ee13-4213-9d2c-f8a7a3ad648d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:01 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.7758b386-ee13-4213-9d2c-f8a7a3ad648d Jul 10 05:03:01 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:01 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:01 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7a42aa9b-1b97-47c5-bb5f-d9d9652c35d5 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.7758b386-ee13-4213-9d2c-f8a7a3ad648d" returned: 0 in 0.753s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:01 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-7a42aa9b-1b97-47c5-bb5f-d9d9652c35d5 tempest-ProjectMemberTests-1536548769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:03:02 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[18eb8d9c-a41d-4dfd-9e12-40993bcebaca]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:03:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7a42aa9b-1b97-47c5-bb5f-d9d9652c35d5 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:02 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67 Jul 10 05:03:02 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:02 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7a42aa9b-1b97-47c5-bb5f-d9d9652c35d5 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67" returned: 0 in 0.766s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7a42aa9b-1b97-47c5-bb5f-d9d9652c35d5 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.7758b386-ee13-4213-9d2c-f8a7a3ad648d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:02 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.7758b386-ee13-4213-9d2c-f8a7a3ad648d Jul 10 05:03:02 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:03 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7a42aa9b-1b97-47c5-bb5f-d9d9652c35d5 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.7758b386-ee13-4213-9d2c-f8a7a3ad648d" returned: 0 in 0.705s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7a42aa9b-1b97-47c5-bb5f-d9d9652c35d5 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.7758b386-ee13-4213-9d2c-f8a7a3ad648d {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:03 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.7758b386-ee13-4213-9d2c-f8a7a3ad648d Jul 10 05:03:03 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:04 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-7a42aa9b-1b97-47c5-bb5f-d9d9652c35d5 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67.7758b386-ee13-4213-9d2c-f8a7a3ad648d" returned: 0 in 0.616s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7a42aa9b-1b97-47c5-bb5f-d9d9652c35d5 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-7758b386-ee13-4213-9d2c-f8a7a3ad648d" released by "_delete_snapshot" :: held 2.929s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:03:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7a42aa9b-1b97-47c5-bb5f-d9d9652c35d5 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-55d33c2d-769c-4c3d-9baf-5cf39e92ca67" released by "delete_snapshot" :: held 2.951s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:03:04 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-7a42aa9b-1b97-47c5-bb5f-d9d9652c35d5 tempest-ProjectMemberTests-1536548769 None] Created reservations ['c55eca22-12ce-4e52-ac54-3231e5e86287', '541e6eaf-7074-4cfe-b167-9119c1dc1c0d', 'af1171c2-c707-4803-93b4-f387807a8203', '78ce500b-25ba-4401-9ec5-f6c08c19fefb'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:03:04 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-7a42aa9b-1b97-47c5-bb5f-d9d9652c35d5 tempest-ProjectMemberTests-1536548769 None] Delete snapshot completed successfully. Jul 10 05:03:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-7a42aa9b-1b97-47c5-bb5f-d9d9652c35d5 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-7758b386-ee13-4213-9d2c-f8a7a3ad648d-delete_snapshot" released by "delete_snapshot" :: held 3.080s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:03:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-78a3c50d-8f8d-4d71-bbe5-12f36a3b02f0 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-55d33c2d-769c-4c3d-9baf-5cf39e92ca67-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:03:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-78a3c50d-8f8d-4d71-bbe5-12f36a3b02f0 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-55d33c2d-769c-4c3d-9baf-5cf39e92ca67-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:03:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-78a3c50d-8f8d-4d71-bbe5-12f36a3b02f0 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-55d33c2d-769c-4c3d-9baf-5cf39e92ca67" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:03:04 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-78a3c50d-8f8d-4d71-bbe5-12f36a3b02f0 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-55d33c2d-769c-4c3d-9baf-5cf39e92ca67" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:03:04 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc77adf4-b1f7-4deb-85a0-29d6fcaf01e0]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:03:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-78a3c50d-8f8d-4d71-bbe5-12f36a3b02f0 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:04 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67 Jul 10 05:03:04 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:05 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-78a3c50d-8f8d-4d71-bbe5-12f36a3b02f0 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67" returned: 0 in 0.736s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-78a3c50d-8f8d-4d71-bbe5-12f36a3b02f0 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:05 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67 Jul 10 05:03:05 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:05 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-78a3c50d-8f8d-4d71-bbe5-12f36a3b02f0 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-55d33c2d-769c-4c3d-9baf-5cf39e92ca67" returned: 0 in 0.664s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:05 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-78a3c50d-8f8d-4d71-bbe5-12f36a3b02f0 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-55d33c2d-769c-4c3d-9baf-5cf39e92ca67" released by "delete_volume" :: held 1.456s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:03:05 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-78a3c50d-8f8d-4d71-bbe5-12f36a3b02f0 tempest-ProjectMemberTests-1536548769 None] Created reservations ['72151492-b4b6-4c71-91f0-61034069075e', '951c14dc-c9b5-4fa1-809b-7f0820f4a4c2', '2e9fa376-f2e7-4c7a-8d47-e1f4928e20ac', '657eae6e-2642-4262-a2e0-b2c350106e0e'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:03:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-78a3c50d-8f8d-4d71-bbe5-12f36a3b02f0 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:03:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-78a3c50d-8f8d-4d71-bbe5-12f36a3b02f0 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:03:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-78a3c50d-8f8d-4d71-bbe5-12f36a3b02f0 tempest-ProjectMemberTests-1536548769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:03:05 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-78a3c50d-8f8d-4d71-bbe5-12f36a3b02f0 tempest-ProjectMemberTests-1536548769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:03:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-78a3c50d-8f8d-4d71-bbe5-12f36a3b02f0 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:03:05 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-78a3c50d-8f8d-4d71-bbe5-12f36a3b02f0 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:05 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:03:05 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:06 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:06 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-78a3c50d-8f8d-4d71-bbe5-12f36a3b02f0 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.650s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:06 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-78a3c50d-8f8d-4d71-bbe5-12f36a3b02f0 tempest-ProjectMemberTests-1536548769 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:03:06 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-78a3c50d-8f8d-4d71-bbe5-12f36a3b02f0 tempest-ProjectMemberTests-1536548769 None] Deleted volume successfully. Jul 10 05:03:06 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-78a3c50d-8f8d-4d71-bbe5-12f36a3b02f0 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-55d33c2d-769c-4c3d-9baf-5cf39e92ca67-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:03:06 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:03:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Flow 'volume_create_manager' (afa1df6a-7f4c-4ef8-92c4-f22478aafb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:03:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a833f8-7dcc-47a1-9c24-84495edf1561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:03:06 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a833f8-7dcc-47a1-9c24-84495edf1561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-205820343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad1adeed-fac6-4cd4-9340-72e13fe2d01c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4b418f932c4d1f8f37edd3cc0b7dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:03:07Z,use_quota=True,user_id='124e0cf464a84f5ab1b9058b1a0fffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:03:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef5a516-27c2-400b-a709-236fec37ea5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:03:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef5a516-27c2-400b-a709-236fec37ea5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:03:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378dc2d7-6c25-4fc2-bc49-2a11c7d0da6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:03:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378dc2d7-6c25-4fc2-bc49-2a11c7d0da6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad1adeed-fac6-4cd4-9340-72e13fe2d01c', 'volume_name': 'volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:03:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e68ab2-fa23-43a0-a872-b10d31fa255b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:03:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e68ab2-fa23-43a0-a872-b10d31fa255b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:03:07 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f81b39b-0247-4a31-9ebb-dc9830b8b5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:03:07 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Volume ad1adeed-fac6-4cd4-9340-72e13fe2d01c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c', 'volume_size': 1} Jul 10 05:03:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:03:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:03:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-205820343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad1adeed-fac6-4cd4-9340-72e13fe2d01c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4b418f932c4d1f8f37edd3cc0b7dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:03:07Z,use_quota=True,user_id='124e0cf464a84f5ab1b9058b1a0fffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:03:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Creating volume ad1adeed-fac6-4cd4-9340-72e13fe2d01c {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:03:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:03:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:03:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:03:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:03:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:03:07 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:03:07 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:03:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:07 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c 1073741824 Jul 10 05:03:07 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:07 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c 1073741824" returned: 0 in 0.824s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:07 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:07 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c Jul 10 05:03:07 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:08 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c" returned: 0 in 0.657s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:08 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:03:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:03:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f81b39b-0247-4a31-9ebb-dc9830b8b5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:03:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b5a39d-5755-4250-803f-40632fe2dbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:03:08 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Volume volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c (ad1adeed-fac6-4cd4-9340-72e13fe2d01c): created successfully Jul 10 05:03:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b5a39d-5755-4250-803f-40632fe2dbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:03:08 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Flow 'volume_create_manager' (afa1df6a-7f4c-4ef8-92c4-f22478aafb18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:03:08 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-4eef5728-5dc5-4508-b022-761c1b41c61d tempest-ProjectMemberTests-1536548769 None] Created volume successfully. Jul 10 05:03:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-039b00c5-c5b8-43f9-93de-a703c9e42e43 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:03:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-039b00c5-c5b8-43f9-93de-a703c9e42e43 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:03:09 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-039b00c5-c5b8-43f9-93de-a703c9e42e43 tempest-ProjectMemberTests-1536548769 None] Creating offline snapshot b733c0c1-fd1c-4393-9d48-94dcd224abe9 of volume ad1adeed-fac6-4cd4-9340-72e13fe2d01c {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:03:09 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[35640554-7ebd-4d9c-bcf3-197c79bac903]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:03:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-039b00c5-c5b8-43f9-93de-a703c9e42e43 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:09 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c Jul 10 05:03:09 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:09 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-039b00c5-c5b8-43f9-93de-a703c9e42e43 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c" returned: 0 in 0.738s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-039b00c5-c5b8-43f9-93de-a703c9e42e43 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.b733c0c1-fd1c-4393-9d48-94dcd224abe9 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:09 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.b733c0c1-fd1c-4393-9d48-94dcd224abe9 1G Jul 10 05:03:09 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:10 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-039b00c5-c5b8-43f9-93de-a703c9e42e43 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.b733c0c1-fd1c-4393-9d48-94dcd224abe9 1G" returned: 0 in 0.792s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-039b00c5-c5b8-43f9-93de-a703c9e42e43 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.b733c0c1-fd1c-4393-9d48-94dcd224abe9 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:10 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.b733c0c1-fd1c-4393-9d48-94dcd224abe9 Jul 10 05:03:10 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:11 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-039b00c5-c5b8-43f9-93de-a703c9e42e43 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.b733c0c1-fd1c-4393-9d48-94dcd224abe9" returned: 0 in 0.666s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:11 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-039b00c5-c5b8-43f9-93de-a703c9e42e43 tempest-ProjectMemberTests-1536548769 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.b733c0c1-fd1c-4393-9d48-94dcd224abe9 is being set with open permissions: ugo+rw Jul 10 05:03:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-039b00c5-c5b8-43f9-93de-a703c9e42e43 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.b733c0c1-fd1c-4393-9d48-94dcd224abe9 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:11 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.b733c0c1-fd1c-4393-9d48-94dcd224abe9 Jul 10 05:03:11 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:12 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-039b00c5-c5b8-43f9-93de-a703c9e42e43 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.b733c0c1-fd1c-4393-9d48-94dcd224abe9" returned: 0 in 0.637s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-039b00c5-c5b8-43f9-93de-a703c9e42e43 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:12 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.info Jul 10 05:03:12 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:12 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-039b00c5-c5b8-43f9-93de-a703c9e42e43 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.info" returned: 0 in 0.631s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:12 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-039b00c5-c5b8-43f9-93de-a703c9e42e43 tempest-ProjectMemberTests-1536548769 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.info is being set with open permissions: ugo+rw Jul 10 05:03:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-039b00c5-c5b8-43f9-93de-a703c9e42e43 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:12 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.info Jul 10 05:03:12 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:13 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-039b00c5-c5b8-43f9-93de-a703c9e42e43 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.info" returned: 0 in 0.652s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-039b00c5-c5b8-43f9-93de-a703c9e42e43 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.194s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:03:13 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-039b00c5-c5b8-43f9-93de-a703c9e42e43 tempest-ProjectMemberTests-1536548769 None] Create snapshot completed successfully Jul 10 05:03:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d6c0df2a-6af2-4c43-87d1-500805eb20c1 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-b733c0c1-fd1c-4393-9d48-94dcd224abe9-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:03:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d6c0df2a-6af2-4c43-87d1-500805eb20c1 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-b733c0c1-fd1c-4393-9d48-94dcd224abe9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:03:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d6c0df2a-6af2-4c43-87d1-500805eb20c1 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-ad1adeed-fac6-4cd4-9340-72e13fe2d01c" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:03:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d6c0df2a-6af2-4c43-87d1-500805eb20c1 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-ad1adeed-fac6-4cd4-9340-72e13fe2d01c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:03:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d6c0df2a-6af2-4c43-87d1-500805eb20c1 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-b733c0c1-fd1c-4393-9d48-94dcd224abe9" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:03:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d6c0df2a-6af2-4c43-87d1-500805eb20c1 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-b733c0c1-fd1c-4393-9d48-94dcd224abe9" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:03:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d6c0df2a-6af2-4c43-87d1-500805eb20c1 tempest-ProjectMemberTests-1536548769 None] Deleting offline snapshot b733c0c1-fd1c-4393-9d48-94dcd224abe9 of volume ad1adeed-fac6-4cd4-9340-72e13fe2d01c {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:03:14 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d6c0df2a-6af2-4c43-87d1-500805eb20c1 tempest-ProjectMemberTests-1536548769 None] snapshot_file for this snap is: volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.b733c0c1-fd1c-4393-9d48-94dcd224abe9 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:03:14 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca345b4-69cb-4f09-847e-cc6b513bba62]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:03:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d6c0df2a-6af2-4c43-87d1-500805eb20c1 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.b733c0c1-fd1c-4393-9d48-94dcd224abe9 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:14 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.b733c0c1-fd1c-4393-9d48-94dcd224abe9 Jul 10 05:03:14 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:15 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d6c0df2a-6af2-4c43-87d1-500805eb20c1 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.b733c0c1-fd1c-4393-9d48-94dcd224abe9" returned: 0 in 0.731s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-d6c0df2a-6af2-4c43-87d1-500805eb20c1 tempest-ProjectMemberTests-1536548769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:03:15 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4a7a47-eeb0-4d2c-8e77-600f85f0b70d]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:03:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d6c0df2a-6af2-4c43-87d1-500805eb20c1 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:15 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c Jul 10 05:03:15 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:03:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:03:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:03:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:03:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:03:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:03:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:15 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:03:15 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:16 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d6c0df2a-6af2-4c43-87d1-500805eb20c1 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c" returned: 0 in 0.771s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d6c0df2a-6af2-4c43-87d1-500805eb20c1 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.b733c0c1-fd1c-4393-9d48-94dcd224abe9 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:16 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.b733c0c1-fd1c-4393-9d48-94dcd224abe9 Jul 10 05:03:16 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:16 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.658s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:03:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:03:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 05:03:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 05:03:16 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d6c0df2a-6af2-4c43-87d1-500805eb20c1 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.b733c0c1-fd1c-4393-9d48-94dcd224abe9" returned: 0 in 0.731s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d6c0df2a-6af2-4c43-87d1-500805eb20c1 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.b733c0c1-fd1c-4393-9d48-94dcd224abe9 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:16 devstack sudo[107916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.b733c0c1-fd1c-4393-9d48-94dcd224abe9 Jul 10 05:03:16 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:17 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-d6c0df2a-6af2-4c43-87d1-500805eb20c1 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c.b733c0c1-fd1c-4393-9d48-94dcd224abe9" returned: 0 in 0.649s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:17 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d6c0df2a-6af2-4c43-87d1-500805eb20c1 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-b733c0c1-fd1c-4393-9d48-94dcd224abe9" released by "_delete_snapshot" :: held 2.967s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:03:17 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d6c0df2a-6af2-4c43-87d1-500805eb20c1 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-ad1adeed-fac6-4cd4-9340-72e13fe2d01c" released by "delete_snapshot" :: held 2.989s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:03:17 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-d6c0df2a-6af2-4c43-87d1-500805eb20c1 tempest-ProjectMemberTests-1536548769 None] Created reservations ['c854c0d1-12d2-43a8-8428-1a46c7701c87', '167d27ad-d684-4224-9d2e-5f09594eb3ab', '03544b54-6786-42c0-8d7d-65966457ae04', '0eea6573-6439-44b4-9bd4-be8e6be4c232'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:03:17 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-d6c0df2a-6af2-4c43-87d1-500805eb20c1 tempest-ProjectMemberTests-1536548769 None] Delete snapshot completed successfully. Jul 10 05:03:17 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-d6c0df2a-6af2-4c43-87d1-500805eb20c1 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-b733c0c1-fd1c-4393-9d48-94dcd224abe9-delete_snapshot" released by "delete_snapshot" :: held 3.127s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:03:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-207f96f0-87ce-4393-b0b7-cc21d700e8f8 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-ad1adeed-fac6-4cd4-9340-72e13fe2d01c-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:03:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-207f96f0-87ce-4393-b0b7-cc21d700e8f8 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-ad1adeed-fac6-4cd4-9340-72e13fe2d01c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:03:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-207f96f0-87ce-4393-b0b7-cc21d700e8f8 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-ad1adeed-fac6-4cd4-9340-72e13fe2d01c" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:03:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-207f96f0-87ce-4393-b0b7-cc21d700e8f8 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-ad1adeed-fac6-4cd4-9340-72e13fe2d01c" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:03:18 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bc0700-7828-4d2e-807e-7e562ff8043d]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:03:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-207f96f0-87ce-4393-b0b7-cc21d700e8f8 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:18 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c Jul 10 05:03:18 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:19 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-207f96f0-87ce-4393-b0b7-cc21d700e8f8 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c" returned: 0 in 0.747s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-207f96f0-87ce-4393-b0b7-cc21d700e8f8 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:19 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c Jul 10 05:03:19 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:20 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-207f96f0-87ce-4393-b0b7-cc21d700e8f8 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-ad1adeed-fac6-4cd4-9340-72e13fe2d01c" returned: 0 in 0.652s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:20 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-207f96f0-87ce-4393-b0b7-cc21d700e8f8 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-ad1adeed-fac6-4cd4-9340-72e13fe2d01c" released by "delete_volume" :: held 1.458s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:03:20 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-207f96f0-87ce-4393-b0b7-cc21d700e8f8 tempest-ProjectMemberTests-1536548769 None] Created reservations ['fc670c65-4528-423a-97f3-67814e332f32', 'e1ae493d-5cb2-4232-bb6a-3efe592af1ab', '90ab3655-0268-40a7-8bee-e485d627445e', '318b5556-b383-4fd6-94ff-0e3bc0d6e6d6'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:03:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-207f96f0-87ce-4393-b0b7-cc21d700e8f8 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:03:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-207f96f0-87ce-4393-b0b7-cc21d700e8f8 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:03:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-207f96f0-87ce-4393-b0b7-cc21d700e8f8 tempest-ProjectMemberTests-1536548769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:03:20 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-207f96f0-87ce-4393-b0b7-cc21d700e8f8 tempest-ProjectMemberTests-1536548769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:03:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-207f96f0-87ce-4393-b0b7-cc21d700e8f8 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:03:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-207f96f0-87ce-4393-b0b7-cc21d700e8f8 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:20 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:03:20 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:20 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:20 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-207f96f0-87ce-4393-b0b7-cc21d700e8f8 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.641s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:20 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-207f96f0-87ce-4393-b0b7-cc21d700e8f8 tempest-ProjectMemberTests-1536548769 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:03:20 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-207f96f0-87ce-4393-b0b7-cc21d700e8f8 tempest-ProjectMemberTests-1536548769 None] Deleted volume successfully. Jul 10 05:03:20 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-207f96f0-87ce-4393-b0b7-cc21d700e8f8 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-ad1adeed-fac6-4cd4-9340-72e13fe2d01c-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:03:21 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:03:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Flow 'volume_create_manager' (7e6e2ea4-fbca-417f-ace0-c5030a1ec9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:03:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e21f2a10-3661-4426-956e-512878bf2642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:03:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e21f2a10-3661-4426-956e-512878bf2642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148130305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d49c5b-a517-430a-9740-b32cb89b624c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4b418f932c4d1f8f37edd3cc0b7dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:03:21Z,use_quota=True,user_id='124e0cf464a84f5ab1b9058b1a0fffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:03:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9b5117-63f3-4a49-8458-70366d18f2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:03:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9b5117-63f3-4a49-8458-70366d18f2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:03:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21fec6f5-f219-40f6-9559-474a2ac4aafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:03:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21fec6f5-f219-40f6-9559-474a2ac4aafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63d49c5b-a517-430a-9740-b32cb89b624c', 'volume_name': 'volume-63d49c5b-a517-430a-9740-b32cb89b624c', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:03:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e4ea87-2df2-45a6-8ee1-d74bfaa5ac44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:03:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e4ea87-2df2-45a6-8ee1-d74bfaa5ac44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:03:21 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d033b40b-23dd-4bc2-b089-689e8b419f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:03:21 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Volume 63d49c5b-a517-430a-9740-b32cb89b624c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63d49c5b-a517-430a-9740-b32cb89b624c', 'volume_size': 1} Jul 10 05:03:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:03:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:03:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148130305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d49c5b-a517-430a-9740-b32cb89b624c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4b418f932c4d1f8f37edd3cc0b7dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:03:21Z,use_quota=True,user_id='124e0cf464a84f5ab1b9058b1a0fffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:03:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Creating volume 63d49c5b-a517-430a-9740-b32cb89b624c {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:03:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:03:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:03:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:03:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:03:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:03:21 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:03:21 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:03:21 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:21 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c 1073741824 Jul 10 05:03:21 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:22 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c 1073741824" returned: 0 in 0.812s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:22 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c Jul 10 05:03:22 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:22 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c" returned: 0 in 0.663s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:22 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:03:22 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:03:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d033b40b-23dd-4bc2-b089-689e8b419f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63d49c5b-a517-430a-9740-b32cb89b624c', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:03:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee06b62-5d0c-4550-8643-09afbcf60dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:03:22 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Volume volume-63d49c5b-a517-430a-9740-b32cb89b624c (63d49c5b-a517-430a-9740-b32cb89b624c): created successfully Jul 10 05:03:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee06b62-5d0c-4550-8643-09afbcf60dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:03:22 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Flow 'volume_create_manager' (7e6e2ea4-fbca-417f-ace0-c5030a1ec9f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:03:22 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-67bd125e-783b-49d3-93d6-7115df86b8d3 tempest-ProjectMemberTests-1536548769 None] Created volume successfully. Jul 10 05:03:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3fa2f04e-a8ed-4d69-b687-7e015407c40c tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:03:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3fa2f04e-a8ed-4d69-b687-7e015407c40c tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:03:23 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-3fa2f04e-a8ed-4d69-b687-7e015407c40c tempest-ProjectMemberTests-1536548769 None] Creating offline snapshot b409e6ca-abbe-46fe-b3c1-790f3134e9f4 of volume 63d49c5b-a517-430a-9740-b32cb89b624c {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:03:23 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00b7155-7040-46f5-a078-d1dad2898cac]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:03:23 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3fa2f04e-a8ed-4d69-b687-7e015407c40c tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:23 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c Jul 10 05:03:23 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:24 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3fa2f04e-a8ed-4d69-b687-7e015407c40c tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c" returned: 0 in 0.765s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:24 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3fa2f04e-a8ed-4d69-b687-7e015407c40c tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.b409e6ca-abbe-46fe-b3c1-790f3134e9f4 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:24 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.b409e6ca-abbe-46fe-b3c1-790f3134e9f4 1G Jul 10 05:03:24 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:25 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3fa2f04e-a8ed-4d69-b687-7e015407c40c tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.b409e6ca-abbe-46fe-b3c1-790f3134e9f4 1G" returned: 0 in 0.810s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3fa2f04e-a8ed-4d69-b687-7e015407c40c tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d49c5b-a517-430a-9740-b32cb89b624c -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.b409e6ca-abbe-46fe-b3c1-790f3134e9f4 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:25 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d49c5b-a517-430a-9740-b32cb89b624c -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.b409e6ca-abbe-46fe-b3c1-790f3134e9f4 Jul 10 05:03:25 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:25 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3fa2f04e-a8ed-4d69-b687-7e015407c40c tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d49c5b-a517-430a-9740-b32cb89b624c -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.b409e6ca-abbe-46fe-b3c1-790f3134e9f4" returned: 0 in 0.697s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:25 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-3fa2f04e-a8ed-4d69-b687-7e015407c40c tempest-ProjectMemberTests-1536548769 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.b409e6ca-abbe-46fe-b3c1-790f3134e9f4 is being set with open permissions: ugo+rw Jul 10 05:03:25 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3fa2f04e-a8ed-4d69-b687-7e015407c40c tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.b409e6ca-abbe-46fe-b3c1-790f3134e9f4 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:25 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.b409e6ca-abbe-46fe-b3c1-790f3134e9f4 Jul 10 05:03:25 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:26 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3fa2f04e-a8ed-4d69-b687-7e015407c40c tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.b409e6ca-abbe-46fe-b3c1-790f3134e9f4" returned: 0 in 0.630s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:26 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3fa2f04e-a8ed-4d69-b687-7e015407c40c tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:26 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.info Jul 10 05:03:26 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:27 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3fa2f04e-a8ed-4d69-b687-7e015407c40c tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.info" returned: 0 in 0.667s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:27 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-3fa2f04e-a8ed-4d69-b687-7e015407c40c tempest-ProjectMemberTests-1536548769 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.info is being set with open permissions: ugo+rw Jul 10 05:03:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3fa2f04e-a8ed-4d69-b687-7e015407c40c tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:27 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.info Jul 10 05:03:27 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:27 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3fa2f04e-a8ed-4d69-b687-7e015407c40c tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.info" returned: 0 in 0.647s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:27 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3fa2f04e-a8ed-4d69-b687-7e015407c40c tempest-ProjectMemberTests-1536548769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.296s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:03:27 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-3fa2f04e-a8ed-4d69-b687-7e015407c40c tempest-ProjectMemberTests-1536548769 None] Create snapshot completed successfully Jul 10 05:03:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9abceb2c-a43c-4ddd-815e-f3f71cf4dc99 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-b409e6ca-abbe-46fe-b3c1-790f3134e9f4-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:03:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9abceb2c-a43c-4ddd-815e-f3f71cf4dc99 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-b409e6ca-abbe-46fe-b3c1-790f3134e9f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:03:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9abceb2c-a43c-4ddd-815e-f3f71cf4dc99 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-63d49c5b-a517-430a-9740-b32cb89b624c" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:03:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9abceb2c-a43c-4ddd-815e-f3f71cf4dc99 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-63d49c5b-a517-430a-9740-b32cb89b624c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:03:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9abceb2c-a43c-4ddd-815e-f3f71cf4dc99 tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-b409e6ca-abbe-46fe-b3c1-790f3134e9f4" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:03:28 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9abceb2c-a43c-4ddd-815e-f3f71cf4dc99 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-b409e6ca-abbe-46fe-b3c1-790f3134e9f4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:03:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-9abceb2c-a43c-4ddd-815e-f3f71cf4dc99 tempest-ProjectMemberTests-1536548769 None] Deleting offline snapshot b409e6ca-abbe-46fe-b3c1-790f3134e9f4 of volume 63d49c5b-a517-430a-9740-b32cb89b624c {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:03:28 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-9abceb2c-a43c-4ddd-815e-f3f71cf4dc99 tempest-ProjectMemberTests-1536548769 None] snapshot_file for this snap is: volume-63d49c5b-a517-430a-9740-b32cb89b624c.b409e6ca-abbe-46fe-b3c1-790f3134e9f4 {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:03:28 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[845726ba-a794-4153-92fd-a9bfaeb766bb]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:03:28 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9abceb2c-a43c-4ddd-815e-f3f71cf4dc99 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.b409e6ca-abbe-46fe-b3c1-790f3134e9f4 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:28 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.b409e6ca-abbe-46fe-b3c1-790f3134e9f4 Jul 10 05:03:28 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:29 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9abceb2c-a43c-4ddd-815e-f3f71cf4dc99 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.b409e6ca-abbe-46fe-b3c1-790f3134e9f4" returned: 0 in 0.769s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:29 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-9abceb2c-a43c-4ddd-815e-f3f71cf4dc99 tempest-ProjectMemberTests-1536548769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63d49c5b-a517-430a-9740-b32cb89b624c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:03:29 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[320e1ec5-34c1-4055-8136-8fb7f99a0436]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:03:29 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9abceb2c-a43c-4ddd-815e-f3f71cf4dc99 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:29 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c Jul 10 05:03:29 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:30 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9abceb2c-a43c-4ddd-815e-f3f71cf4dc99 tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c" returned: 0 in 0.770s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:30 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9abceb2c-a43c-4ddd-815e-f3f71cf4dc99 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.b409e6ca-abbe-46fe-b3c1-790f3134e9f4 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:30 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.b409e6ca-abbe-46fe-b3c1-790f3134e9f4 Jul 10 05:03:30 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:31 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9abceb2c-a43c-4ddd-815e-f3f71cf4dc99 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.b409e6ca-abbe-46fe-b3c1-790f3134e9f4" returned: 0 in 0.734s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9abceb2c-a43c-4ddd-815e-f3f71cf4dc99 tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.b409e6ca-abbe-46fe-b3c1-790f3134e9f4 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:31 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.b409e6ca-abbe-46fe-b3c1-790f3134e9f4 Jul 10 05:03:31 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:31 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:31 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-9abceb2c-a43c-4ddd-815e-f3f71cf4dc99 tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c.b409e6ca-abbe-46fe-b3c1-790f3134e9f4" returned: 0 in 0.641s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:31 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9abceb2c-a43c-4ddd-815e-f3f71cf4dc99 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-b409e6ca-abbe-46fe-b3c1-790f3134e9f4" released by "_delete_snapshot" :: held 2.997s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:03:31 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9abceb2c-a43c-4ddd-815e-f3f71cf4dc99 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-63d49c5b-a517-430a-9740-b32cb89b624c" released by "delete_snapshot" :: held 3.018s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:03:31 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-9abceb2c-a43c-4ddd-815e-f3f71cf4dc99 tempest-ProjectMemberTests-1536548769 None] Created reservations ['5f065970-4498-4820-aed9-e6e282c40534', 'af42a6a4-8290-4f90-92a8-14c41d2079d0', '3c4eb37e-e4c8-4d21-b1ef-e825ce967587', 'af1c7c56-8df1-43b2-a1a2-4d34a214423a'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:03:31 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-9abceb2c-a43c-4ddd-815e-f3f71cf4dc99 tempest-ProjectMemberTests-1536548769 None] Delete snapshot completed successfully. Jul 10 05:03:31 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-9abceb2c-a43c-4ddd-815e-f3f71cf4dc99 tempest-ProjectMemberTests-1536548769 None] Lock "cinder-b409e6ca-abbe-46fe-b3c1-790f3134e9f4-delete_snapshot" released by "delete_snapshot" :: held 3.157s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:03:32 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1def1cfd-fd1d-423f-971a-4c80a6db15ea tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-63d49c5b-a517-430a-9740-b32cb89b624c-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:03:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1def1cfd-fd1d-423f-971a-4c80a6db15ea tempest-ProjectMemberTests-1536548769 None] Lock "cinder-63d49c5b-a517-430a-9740-b32cb89b624c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:03:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1def1cfd-fd1d-423f-971a-4c80a6db15ea tempest-ProjectMemberTests-1536548769 None] Acquiring lock "cinder-quobyte-63d49c5b-a517-430a-9740-b32cb89b624c" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:03:33 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1def1cfd-fd1d-423f-971a-4c80a6db15ea tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-63d49c5b-a517-430a-9740-b32cb89b624c" acquired by "delete_volume" :: waited 0.016s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:03:33 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf8a32c-0d8f-4c0e-8748-cb8aab3d8dc7]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:03:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1def1cfd-fd1d-423f-971a-4c80a6db15ea tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:33 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c Jul 10 05:03:33 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:33 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1def1cfd-fd1d-423f-971a-4c80a6db15ea tempest-ProjectMemberTests-1536548769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c" returned: 0 in 0.760s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:33 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1def1cfd-fd1d-423f-971a-4c80a6db15ea tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:33 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c Jul 10 05:03:33 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:34 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1def1cfd-fd1d-423f-971a-4c80a6db15ea tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-63d49c5b-a517-430a-9740-b32cb89b624c" returned: 0 in 0.665s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:34 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1def1cfd-fd1d-423f-971a-4c80a6db15ea tempest-ProjectMemberTests-1536548769 None] Lock "cinder-quobyte-63d49c5b-a517-430a-9740-b32cb89b624c" released by "delete_volume" :: held 1.481s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:03:34 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-1def1cfd-fd1d-423f-971a-4c80a6db15ea tempest-ProjectMemberTests-1536548769 None] Created reservations ['375472a3-d1d7-4963-800a-85246cfb3d3b', '00cc4264-18fb-4a10-8359-1d3a542632c4', '7233b8f1-0d99-4748-bc6a-8e9bee12fc2d', 'b7613ecb-eae3-4001-a57e-fe252c915806'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:03:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1def1cfd-fd1d-423f-971a-4c80a6db15ea tempest-ProjectMemberTests-1536548769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:03:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1def1cfd-fd1d-423f-971a-4c80a6db15ea tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:03:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1def1cfd-fd1d-423f-971a-4c80a6db15ea tempest-ProjectMemberTests-1536548769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:03:34 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-1def1cfd-fd1d-423f-971a-4c80a6db15ea tempest-ProjectMemberTests-1536548769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:03:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-1def1cfd-fd1d-423f-971a-4c80a6db15ea tempest-ProjectMemberTests-1536548769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:03:34 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1def1cfd-fd1d-423f-971a-4c80a6db15ea tempest-ProjectMemberTests-1536548769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:34 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:03:34 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:35 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:35 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-1def1cfd-fd1d-423f-971a-4c80a6db15ea tempest-ProjectMemberTests-1536548769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.661s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:35 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-1def1cfd-fd1d-423f-971a-4c80a6db15ea tempest-ProjectMemberTests-1536548769 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:03:35 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-1def1cfd-fd1d-423f-971a-4c80a6db15ea tempest-ProjectMemberTests-1536548769 None] Deleted volume successfully. Jul 10 05:03:35 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-1def1cfd-fd1d-423f-971a-4c80a6db15ea tempest-ProjectMemberTests-1536548769 None] Lock "cinder-63d49c5b-a517-430a-9740-b32cb89b624c-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:03:44 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=108,cinder:SELECT=69,cinder:INSERT=30,cinder:DELETE=8 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:03:45 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=78,cinder:UPDATE=95,cinder:INSERT=24,cinder:DELETE=9 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:03:54 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:03:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Flow 'volume_create_manager' (bc7ed642-346e-4344-bb45-61121ba3fcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:03:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd27f6d7-cd0e-48ca-aeb0-5104c15cdc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:03:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd27f6d7-cd0e-48ca-aeb0-5104c15cdc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1879183211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c4a8fa-a886-4ea3-8759-5d09a22f1b0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b688837763c4ae2ab518aabe8023730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:03:54Z,use_quota=True,user_id='84a07a2442004bcbb1e54096e13e11f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:03:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f0d596-6b0b-441e-b04f-dcc6be3fb1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:03:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f0d596-6b0b-441e-b04f-dcc6be3fb1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:03:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7be966f-02af-4e42-869d-223ccd89a8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:03:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7be966f-02af-4e42-869d-223ccd89a8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24c4a8fa-a886-4ea3-8759-5d09a22f1b0a', 'volume_name': 'volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:03:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d4a103f-f6fb-4886-a172-96977e0293f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:03:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d4a103f-f6fb-4886-a172-96977e0293f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:03:54 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d3d1192-4b06-4e95-8de0-fd891dd2d182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:03:54 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Volume 24c4a8fa-a886-4ea3-8759-5d09a22f1b0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a', 'volume_size': 1} Jul 10 05:03:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:03:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:03:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1879183211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c4a8fa-a886-4ea3-8759-5d09a22f1b0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b688837763c4ae2ab518aabe8023730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:03:54Z,use_quota=True,user_id='84a07a2442004bcbb1e54096e13e11f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)}" {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:03:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Creating volume 24c4a8fa-a886-4ea3-8759-5d09a22f1b0a {{(pid=87359) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:03:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:03:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:03:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:03:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:03:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:03:54 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:03:54 devstack cinder-volume[87359]: INFO cinder.volume.drivers.remotefs [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] casted to osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 Jul 10 05:03:54 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a 1073741824 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:54 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a 1073741824 Jul 10 05:03:54 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:55 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a 1073741824" returned: 0 in 0.794s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:55 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a Jul 10 05:03:55 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:55 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a" returned: 0 in 0.622s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:55 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'} {{(pid=87359) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:03:55 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:03:55 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d3d1192-4b06-4e95-8de0-fd891dd2d182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a', 'volume_size': 1}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:03:55 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a274ac-5d67-44a7-b79c-f6cd689d2351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:03:55 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Volume volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a (24c4a8fa-a886-4ea3-8759-5d09a22f1b0a): created successfully Jul 10 05:03:55 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a274ac-5d67-44a7-b79c-f6cd689d2351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:03:55 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Flow 'volume_create_manager' (bc7ed642-346e-4344-bb45-61121ba3fcd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:03:55 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-23c692db-0452-4d6e-980c-6f107a6a22ea tempest-SnapshotDependencyTests-2072148459 None] Created volume successfully. Jul 10 05:03:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3eab9804-e8d2-49bc-9589-5da2f4b9b871 tempest-SnapshotDependencyTests-2072148459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:03:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3eab9804-e8d2-49bc-9589-5da2f4b9b871 tempest-SnapshotDependencyTests-2072148459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:03:56 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-3eab9804-e8d2-49bc-9589-5da2f4b9b871 tempest-SnapshotDependencyTests-2072148459 None] Creating offline snapshot 9b271404-ac0c-4b7e-926b-d04d00cfab2c of volume 24c4a8fa-a886-4ea3-8759-5d09a22f1b0a {{(pid=87359) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:03:56 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35a052c-22c6-4aab-9ff0-5df292afd213]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:03:56 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3eab9804-e8d2-49bc-9589-5da2f4b9b871 tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:56 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a Jul 10 05:03:56 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:57 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3eab9804-e8d2-49bc-9589-5da2f4b9b871 tempest-SnapshotDependencyTests-2072148459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a" returned: 0 in 0.731s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:57 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3eab9804-e8d2-49bc-9589-5da2f4b9b871 tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c 1G {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:57 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c 1G Jul 10 05:03:57 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:58 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3eab9804-e8d2-49bc-9589-5da2f4b9b871 tempest-SnapshotDependencyTests-2072148459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c 1G" returned: 0 in 0.785s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3eab9804-e8d2-49bc-9589-5da2f4b9b871 tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:58 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c Jul 10 05:03:58 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:58 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3eab9804-e8d2-49bc-9589-5da2f4b9b871 tempest-SnapshotDependencyTests-2072148459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a -F qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c" returned: 0 in 0.663s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:58 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-3eab9804-e8d2-49bc-9589-5da2f4b9b871 tempest-SnapshotDependencyTests-2072148459 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c is being set with open permissions: ugo+rw Jul 10 05:03:58 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3eab9804-e8d2-49bc-9589-5da2f4b9b871 tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:58 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c Jul 10 05:03:58 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:03:59 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Jul 10 05:03:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3eab9804-e8d2-49bc-9589-5da2f4b9b871 tempest-SnapshotDependencyTests-2072148459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c" returned: 0 in 0.622s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:03:59 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3eab9804-e8d2-49bc-9589-5da2f4b9b871 tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:03:59 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.info Jul 10 05:03:59 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:04:00 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Jul 10 05:04:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3eab9804-e8d2-49bc-9589-5da2f4b9b871 tempest-SnapshotDependencyTests-2072148459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.info" returned: 0 in 0.642s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:04:00 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-3eab9804-e8d2-49bc-9589-5da2f4b9b871 tempest-SnapshotDependencyTests-2072148459 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.info is being set with open permissions: ugo+rw Jul 10 05:04:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3eab9804-e8d2-49bc-9589-5da2f4b9b871 tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.info {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:04:00 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.info Jul 10 05:04:00 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:04:00 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Jul 10 05:04:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-3eab9804-e8d2-49bc-9589-5da2f4b9b871 tempest-SnapshotDependencyTests-2072148459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.info" returned: 0 in 0.621s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:04:00 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-3eab9804-e8d2-49bc-9589-5da2f4b9b871 tempest-SnapshotDependencyTests-2072148459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.147s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:04:00 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-3eab9804-e8d2-49bc-9589-5da2f4b9b871 tempest-SnapshotDependencyTests-2072148459 None] Create snapshot completed successfully Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87359) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Flow 'volume_create_manager' (1ddcaaaf-756a-41f3-b3c7-b8f2fb61ff95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b010a1df-2d73-4227-a609-a1716b49f1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b010a1df-2d73-4227-a609-a1716b49f1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0864a663-7f2a-4e7c-8031-decbde485372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b688837763c4ae2ab518aabe8023730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9b271404-ac0c-4b7e-926b-d04d00cfab2c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:04:02Z,use_quota=True,user_id='84a07a2442004bcbb1e54096e13e11f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd),volume_type_id=8400e389-d8e6-4ad6-8a6f-ad0c62f0c2dd)' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (462bd039-4886-415e-90a9-6118ce843bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (462bd039-4886-415e-90a9-6118ce843bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf548cf-66a1-4013-a245-1165ea22d504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf548cf-66a1-4013-a245-1165ea22d504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0864a663-7f2a-4e7c-8031-decbde485372', 'volume_name': 'volume-0864a663-7f2a-4e7c-8031-decbde485372', 'volume_size': 1, 'snapshot_id': '9b271404-ac0c-4b7e-926b-d04d00cfab2c'}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a30f20e0-5736-4704-9938-3393aad85bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a30f20e0-5736-4704-9938-3393aad85bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce508b68-03ff-4a53-9e13-b9bbc5ecfcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:04:02 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Volume 0864a663-7f2a-4e7c-8031-decbde485372: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0864a663-7f2a-4e7c-8031-decbde485372', 'volume_size': 1, 'snapshot_id': '9b271404-ac0c-4b7e-926b-d04d00cfab2c'} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Acquiring lock "cinder-quobyte-9b271404-ac0c-4b7e-926b-d04d00cfab2c-0864a663-7f2a-4e7c-8031-decbde485372" by "_create_volume_from_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Lock "cinder-quobyte-9b271404-ac0c-4b7e-926b-d04d00cfab2c-0864a663-7f2a-4e7c-8031-decbde485372" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Creating volume 0864a663-7f2a-4e7c-8031-decbde485372 from snapshot 9b271404-ac0c-4b7e-926b-d04d00cfab2c {{(pid=87359) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Selected osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31 as target Quobyte volume. {{(pid=87359) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Acquiring lock "cinder-quobyte-0864a663-7f2a-4e7c-8031-decbde485372" by "_copy_volume_from_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Lock "cinder-quobyte-0864a663-7f2a-4e7c-8031-decbde485372" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] snapshot: 9b271404-ac0c-4b7e-926b-d04d00cfab2c, volume: 0864a663-7f2a-4e7c-8031-decbde485372, {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b84d03-d567-41f5-82f3-ef33aebdf8f3]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:04:02 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:04:02 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c Jul 10 05:04:02 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:04:03 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Jul 10 05:04:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c" returned: 0 in 0.759s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:04:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:04:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 05:04:03 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Creating direct copy from snapshot {{(pid=87359) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 05:04:03 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e00bc81-3e73-46ac-8e13-31f40429f8fc]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:04:03 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:04:03 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a Jul 10 05:04:03 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:04:04 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Jul 10 05:04:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a" returned: 0 in 0.737s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:04:04 devstack cinder-volume[87359]: DEBUG cinder.utils [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Path /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0864a663-7f2a-4e7c-8031-decbde485372 not found in is_blk_device check {{(pid=87359) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 05:04:04 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0864a663-7f2a-4e7c-8031-decbde485372 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:04:04 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0864a663-7f2a-4e7c-8031-decbde485372 Jul 10 05:04:04 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:04:08 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Jul 10 05:04:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0864a663-7f2a-4e7c-8031-decbde485372" returned: 0 in 4.406s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:04:08 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1627dcb-cfaa-41f9-9d86-f341df5bf2b3]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:04:08 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:04:08 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a Jul 10 05:04:08 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:04:09 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Jul 10 05:04:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a" returned: 0 in 0.923s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:04:09 devstack cinder-volume[87359]: DEBUG cinder.image.image_utils [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a, size 1024.00 MB, duration 4.41 sec, destination /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0864a663-7f2a-4e7c-8031-decbde485372 {{(pid=87359) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 05:04:09 devstack cinder-volume[87359]: INFO cinder.image.image_utils [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Converted 1024.00 MB image at 232.32 MB/s Jul 10 05:04:09 devstack cinder-volume[87359]: WARNING cinder.volume.drivers.remotefs [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0864a663-7f2a-4e7c-8031-decbde485372 is being set with open permissions: ugo+rw Jul 10 05:04:09 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0864a663-7f2a-4e7c-8031-decbde485372 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:04:09 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0864a663-7f2a-4e7c-8031-decbde485372 Jul 10 05:04:09 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:04:10 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Jul 10 05:04:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0864a663-7f2a-4e7c-8031-decbde485372" returned: 0 in 0.659s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:04:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Lock "cinder-quobyte-0864a663-7f2a-4e7c-8031-decbde485372" released by "_copy_volume_from_snapshot" :: held 7.567s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:04:10 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Lock "cinder-quobyte-9b271404-ac0c-4b7e-926b-d04d00cfab2c-0864a663-7f2a-4e7c-8031-decbde485372" released by "_create_volume_from_snapshot" :: held 7.596s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:04:10 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.610s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:04:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce508b68-03ff-4a53-9e13-b9bbc5ecfcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0864a663-7f2a-4e7c-8031-decbde485372', 'volume_size': 1, 'snapshot_id': '9b271404-ac0c-4b7e-926b-d04d00cfab2c'}' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:04:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35aa2718-d2e6-4a13-bfdc-56a008ecf430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:04:10 devstack cinder-volume[87359]: INFO cinder.volume.flows.manager.create_volume [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Volume volume-0864a663-7f2a-4e7c-8031-decbde485372 (0864a663-7f2a-4e7c-8031-decbde485372): created successfully Jul 10 05:04:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35aa2718-d2e6-4a13-bfdc-56a008ecf430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87359) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:04:10 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Flow 'volume_create_manager' (1ddcaaaf-756a-41f3-b3c7-b8f2fb61ff95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87359) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:04:10 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-76b9227f-0af7-4d09-bc20-1e2d2399c1fa tempest-SnapshotDependencyTests-2072148459 None] Created volume successfully. Jul 10 05:04:11 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-75cedb97-3259-4bf4-8976-031714009a42 tempest-SnapshotDependencyTests-2072148459 None] Acquiring lock "cinder-9b271404-ac0c-4b7e-926b-d04d00cfab2c-delete_snapshot" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:04:11 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-75cedb97-3259-4bf4-8976-031714009a42 tempest-SnapshotDependencyTests-2072148459 None] Lock "cinder-9b271404-ac0c-4b7e-926b-d04d00cfab2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:04:11 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-75cedb97-3259-4bf4-8976-031714009a42 tempest-SnapshotDependencyTests-2072148459 None] Acquiring lock "cinder-quobyte-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a" by "delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:04:11 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-75cedb97-3259-4bf4-8976-031714009a42 tempest-SnapshotDependencyTests-2072148459 None] Lock "cinder-quobyte-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:04:11 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-75cedb97-3259-4bf4-8976-031714009a42 tempest-SnapshotDependencyTests-2072148459 None] Acquiring lock "cinder-quobyte-9b271404-ac0c-4b7e-926b-d04d00cfab2c" by "_delete_snapshot" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:04:11 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-75cedb97-3259-4bf4-8976-031714009a42 tempest-SnapshotDependencyTests-2072148459 None] Lock "cinder-quobyte-9b271404-ac0c-4b7e-926b-d04d00cfab2c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:04:11 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-75cedb97-3259-4bf4-8976-031714009a42 tempest-SnapshotDependencyTests-2072148459 None] Deleting offline snapshot 9b271404-ac0c-4b7e-926b-d04d00cfab2c of volume 24c4a8fa-a886-4ea3-8759-5d09a22f1b0a {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:04:11 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-75cedb97-3259-4bf4-8976-031714009a42 tempest-SnapshotDependencyTests-2072148459 None] snapshot_file for this snap is: volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c {{(pid=87359) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:04:11 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d73e2e-1351-4830-992d-e789fad961dc]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:04:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-75cedb97-3259-4bf4-8976-031714009a42 tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:04:11 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c Jul 10 05:04:11 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:04:11 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Jul 10 05:04:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-75cedb97-3259-4bf4-8976-031714009a42 tempest-SnapshotDependencyTests-2072148459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c" returned: 0 in 0.779s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:04:11 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.remotefs [None req-75cedb97-3259-4bf4-8976-031714009a42 tempest-SnapshotDependencyTests-2072148459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87359) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:04:11 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e36e00-809b-402b-b113-4545e3131895]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:04:11 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-75cedb97-3259-4bf4-8976-031714009a42 tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:04:12 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a Jul 10 05:04:12 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:04:12 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Jul 10 05:04:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-75cedb97-3259-4bf4-8976-031714009a42 tempest-SnapshotDependencyTests-2072148459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a" returned: 0 in 0.735s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:04:12 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-75cedb97-3259-4bf4-8976-031714009a42 tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:04:12 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c Jul 10 05:04:12 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:04:13 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Jul 10 05:04:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-75cedb97-3259-4bf4-8976-031714009a42 tempest-SnapshotDependencyTests-2072148459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c" returned: 0 in 0.721s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:04:13 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-75cedb97-3259-4bf4-8976-031714009a42 tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:04:13 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c Jul 10 05:04:13 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:04:14 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Jul 10 05:04:14 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-75cedb97-3259-4bf4-8976-031714009a42 tempest-SnapshotDependencyTests-2072148459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a.9b271404-ac0c-4b7e-926b-d04d00cfab2c" returned: 0 in 0.643s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:04:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-75cedb97-3259-4bf4-8976-031714009a42 tempest-SnapshotDependencyTests-2072148459 None] Lock "cinder-quobyte-9b271404-ac0c-4b7e-926b-d04d00cfab2c" released by "_delete_snapshot" :: held 2.975s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:04:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-75cedb97-3259-4bf4-8976-031714009a42 tempest-SnapshotDependencyTests-2072148459 None] Lock "cinder-quobyte-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a" released by "delete_snapshot" :: held 2.995s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:04:14 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-75cedb97-3259-4bf4-8976-031714009a42 tempest-SnapshotDependencyTests-2072148459 None] Created reservations ['e5e4992d-0e57-41d8-ad24-dc5e8e00689a', 'f8d0037f-3077-4199-b127-d3b3476a245e', 'c55b5e1c-825d-4217-943d-bebd68580837', 'cd5b3cf9-f23a-4cfb-ae75-18f72a0883ac'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:04:14 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-75cedb97-3259-4bf4-8976-031714009a42 tempest-SnapshotDependencyTests-2072148459 None] Delete snapshot completed successfully. Jul 10 05:04:14 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-75cedb97-3259-4bf4-8976-031714009a42 tempest-SnapshotDependencyTests-2072148459 None] Lock "cinder-9b271404-ac0c-4b7e-926b-d04d00cfab2c-delete_snapshot" released by "delete_snapshot" :: held 3.126s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:04:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-98eb1869-f05a-4a4f-ae90-6317427674d3 tempest-SnapshotDependencyTests-2072148459 None] Acquiring lock "cinder-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:04:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-98eb1869-f05a-4a4f-ae90-6317427674d3 tempest-SnapshotDependencyTests-2072148459 None] Lock "cinder-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:04:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-98eb1869-f05a-4a4f-ae90-6317427674d3 tempest-SnapshotDependencyTests-2072148459 None] Acquiring lock "cinder-quobyte-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:04:15 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-98eb1869-f05a-4a4f-ae90-6317427674d3 tempest-SnapshotDependencyTests-2072148459 None] Lock "cinder-quobyte-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a" acquired by "delete_volume" :: waited 0.015s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:04:15 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[229d1965-f4a2-4204-a640-0c9016dbbfd7]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:04:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-98eb1869-f05a-4a4f-ae90-6317427674d3 tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:04:15 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a Jul 10 05:04:15 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:04:15 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:04:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:04:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:04:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:04:15 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:04:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:04:15 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:04:15 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:04:15 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:04:16 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Jul 10 05:04:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-98eb1869-f05a-4a4f-ae90-6317427674d3 tempest-SnapshotDependencyTests-2072148459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a" returned: 0 in 0.761s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:04:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-98eb1869-f05a-4a4f-ae90-6317427674d3 tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:04:16 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a Jul 10 05:04:16 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:04:16 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Jul 10 05:04:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.628s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:04:16 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:04:16 devstack cinder-volume[87359]: DEBUG oslo_service.periodic_task [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] Running periodic task VolumeManager._thread_info {{(pid=87359) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:04:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread count: 28 {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5523}} Jul 10 05:04:16 devstack cinder-volume[87359]: DEBUG cinder.volume.manager [None req-07d764fe-8ff6-43c6-9bf5-dc9a134e869d None None] thread info: [<_MainThread(MainThread, started 134965079847040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87359) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5524}} Jul 10 05:04:16 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Jul 10 05:04:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-98eb1869-f05a-4a4f-ae90-6317427674d3 tempest-SnapshotDependencyTests-2072148459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a" returned: 0 in 0.653s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:04:16 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-98eb1869-f05a-4a4f-ae90-6317427674d3 tempest-SnapshotDependencyTests-2072148459 None] Lock "cinder-quobyte-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a" released by "delete_volume" :: held 1.466s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:04:16 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-98eb1869-f05a-4a4f-ae90-6317427674d3 tempest-SnapshotDependencyTests-2072148459 None] Created reservations ['0b280713-41f5-4fdd-939a-999eb88e8b6c', '4d6136a8-9a96-4a6f-a555-4bacf3b108bb', '47b1b5f3-796a-4fbc-96a6-d27907feaf51', '68335793-7804-434d-9fa2-8049482b8a78'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:04:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-98eb1869-f05a-4a4f-ae90-6317427674d3 tempest-SnapshotDependencyTests-2072148459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:04:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-98eb1869-f05a-4a4f-ae90-6317427674d3 tempest-SnapshotDependencyTests-2072148459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:04:16 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-98eb1869-f05a-4a4f-ae90-6317427674d3 tempest-SnapshotDependencyTests-2072148459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:04:16 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-98eb1869-f05a-4a4f-ae90-6317427674d3 tempest-SnapshotDependencyTests-2072148459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:04:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-98eb1869-f05a-4a4f-ae90-6317427674d3 tempest-SnapshotDependencyTests-2072148459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:04:16 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-98eb1869-f05a-4a4f-ae90-6317427674d3 tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:04:16 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:04:16 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:04:17 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0eb869e0-8c1d-40d0-a4e5-f8d68a486bb1 tempest-SnapshotDependencyTests-2072148459 None] Acquiring lock "cinder-0864a663-7f2a-4e7c-8031-decbde485372-delete_volume" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:04:17 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0eb869e0-8c1d-40d0-a4e5-f8d68a486bb1 tempest-SnapshotDependencyTests-2072148459 None] Lock "cinder-0864a663-7f2a-4e7c-8031-decbde485372-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:04:17 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0eb869e0-8c1d-40d0-a4e5-f8d68a486bb1 tempest-SnapshotDependencyTests-2072148459 None] Acquiring lock "cinder-quobyte-0864a663-7f2a-4e7c-8031-decbde485372" by "delete_volume" {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:04:17 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Jul 10 05:04:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-98eb1869-f05a-4a4f-ae90-6317427674d3 tempest-SnapshotDependencyTests-2072148459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.652s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:04:17 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-98eb1869-f05a-4a4f-ae90-6317427674d3 tempest-SnapshotDependencyTests-2072148459 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:04:17 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0eb869e0-8c1d-40d0-a4e5-f8d68a486bb1 tempest-SnapshotDependencyTests-2072148459 None] Lock "cinder-quobyte-0864a663-7f2a-4e7c-8031-decbde485372" acquired by "delete_volume" :: waited 0.018s {{(pid=87359) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:04:17 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-98eb1869-f05a-4a4f-ae90-6317427674d3 tempest-SnapshotDependencyTests-2072148459 None] Deleted volume successfully. Jul 10 05:04:17 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-98eb1869-f05a-4a4f-ae90-6317427674d3 tempest-SnapshotDependencyTests-2072148459 None] Lock "cinder-24c4a8fa-a886-4ea3-8759-5d09a22f1b0a-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:04:17 devstack cinder-volume[87359]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc3bbcb-ecf0-46e6-a0b0-046e8ee992a0]: (4, 'qcow2') {{(pid=88002) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:04:17 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0eb869e0-8c1d-40d0-a4e5-f8d68a486bb1 tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0864a663-7f2a-4e7c-8031-decbde485372 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:04:17 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0864a663-7f2a-4e7c-8031-decbde485372 Jul 10 05:04:17 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:04:18 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Jul 10 05:04:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0eb869e0-8c1d-40d0-a4e5-f8d68a486bb1 tempest-SnapshotDependencyTests-2072148459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0864a663-7f2a-4e7c-8031-decbde485372" returned: 0 in 0.734s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:04:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0eb869e0-8c1d-40d0-a4e5-f8d68a486bb1 tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0864a663-7f2a-4e7c-8031-decbde485372 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:04:18 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0864a663-7f2a-4e7c-8031-decbde485372 Jul 10 05:04:18 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:04:18 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Jul 10 05:04:18 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0eb869e0-8c1d-40d0-a4e5-f8d68a486bb1 tempest-SnapshotDependencyTests-2072148459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713/volume-0864a663-7f2a-4e7c-8031-decbde485372" returned: 0 in 0.626s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:04:18 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0eb869e0-8c1d-40d0-a4e5-f8d68a486bb1 tempest-SnapshotDependencyTests-2072148459 None] Lock "cinder-quobyte-0864a663-7f2a-4e7c-8031-decbde485372" released by "delete_volume" :: held 1.414s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:04:18 devstack cinder-volume[87359]: DEBUG cinder.quota [None req-0eb869e0-8c1d-40d0-a4e5-f8d68a486bb1 tempest-SnapshotDependencyTests-2072148459 None] Created reservations ['f9dd49a7-3992-4960-be44-fa1ab144e641', '517ba67a-9c97-4869-800f-4f11157bc0a8', '0b32f357-bd01-4295-9315-3342bf78886f', 'e1914f45-1376-4272-90e0-6c1a59604914'] {{(pid=87359) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:04:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0eb869e0-8c1d-40d0-a4e5-f8d68a486bb1 tempest-SnapshotDependencyTests-2072148459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:04:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0eb869e0-8c1d-40d0-a4e5-f8d68a486bb1 tempest-SnapshotDependencyTests-2072148459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:04:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-0eb869e0-8c1d-40d0-a4e5-f8d68a486bb1 tempest-SnapshotDependencyTests-2072148459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31': None} {{(pid=87359) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:04:19 devstack cinder-volume[87359]: DEBUG cinder.volume.drivers.quobyte [None req-0eb869e0-8c1d-40d0-a4e5-f8d68a486bb1 tempest-SnapshotDependencyTests-2072148459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-83c95e6a-c14f-41a4-a037-e0aa9664af31'] {{(pid=87359) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:04:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.lockutils [None req-0eb869e0-8c1d-40d0-a4e5-f8d68a486bb1 tempest-SnapshotDependencyTests-2072148459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87359) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:04:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0eb869e0-8c1d-40d0-a4e5-f8d68a486bb1 tempest-SnapshotDependencyTests-2072148459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:04:19 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713 Jul 10 05:04:19 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:04:19 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Jul 10 05:04:19 devstack cinder-volume[87359]: DEBUG oslo_concurrency.processutils [None req-0eb869e0-8c1d-40d0-a4e5-f8d68a486bb1 tempest-SnapshotDependencyTests-2072148459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c6759929ff6bfb0b38c73a47f547713" returned: 0 in 0.665s {{(pid=87359) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:04:19 devstack cinder-volume[87359]: DEBUG cinder.manager [None req-0eb869e0-8c1d-40d0-a4e5-f8d68a486bb1 tempest-SnapshotDependencyTests-2072148459 None] Notifying Schedulers of capabilities ... {{(pid=87359) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:04:19 devstack cinder-volume[87359]: INFO cinder.volume.manager [None req-0eb869e0-8c1d-40d0-a4e5-f8d68a486bb1 tempest-SnapshotDependencyTests-2072148459 None] Deleted volume successfully. Jul 10 05:04:19 devstack cinder-volume[87359]: DEBUG cinder.coordination [None req-0eb869e0-8c1d-40d0-a4e5-f8d68a486bb1 tempest-SnapshotDependencyTests-2072148459 None] Lock "cinder-0864a663-7f2a-4e7c-8031-decbde485372-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=87359) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:04:29 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:SELECT=25,cinder:UPDATE=29,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:04:29 devstack cinder-volume[87359]: DEBUG dbcounter [-] [87359] Writing DB stats cinder:UPDATE=28,cinder:SELECT=23,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}